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INTROOOCTXON 

On*  of  th*  moat  important  waapon  ayatam  acquialtion 
concapta  to  amarga  In  racant  yaara  la  that  of  Ufa  cycle 
coating  (LCC) . National  laadarahip  and  Dapartmant  of 
Oafanaa  (000)  top  managamant  hava  racognizad  that  the  coat 
of  acquiring  and  aupporting  waapon  ayatema  ia  far  too  high. 
In  pravioua  yaa^a,  ayatema  were  (and  still  uaually  are) 
procured  on  the  baaia  of  beat  technical  performance  and 
loweat  acquisition  cost.  The  LCC  concept,  on  the  other 
hand,  dictates  that  the  Services  define  their  minimum 
acceptable  requirements  and  then  procure  the  system  which 
will  maet  those  minimum  requirements  at  the  lowest  cost 
for  the  entire  life  of  the  system  (34:1). 

Oespite  the  intent  of  000  and  Service  management, 
there  are  many  factors  which  often  prevent,  or  at  least 
hinder,  the  coiaplet*  and  faithful  adherence  to  LCC  objec- 
tives. These  factors  are  particularly  troublasome  for  the 
manager  of  the  less  than  major  program^  (hereafter  called 


^A  less  than  major  program  is  defined  by  000  to  be 
an  equipsant  acquisition  which  is  less  than  $75  million  in 
reaaarcn,  development,  test  and  evaluation  (R0T6E  or  R6D) 
funds  or  less  than  $300  million  in  production  funds.  In 
practice,  a leas  than  major  program  can  range  from  a one- 
of-a-kind  RDT6E  model  to  a multi-million  dollar  production 
program  for  the  entire  fleet  of  United  States  Air  Force 
(USAF)  aircraft  (38:2). 
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th«  program  auunagar)  who  noxaally  has  aavara  manpower/ 
funding,  and  schedule  constraints. 


I 


Background 

Preliminary  investigation  ’by" the  researchers  indi- 
cated that  program  managers,  for  a wide  variety  of  reasons, 
are  frequently  unable  to  apply  LCC  principles  in  a con- 
sistently effective  manner  to  less  than  major  system 
acquisition  programs.  These  reasons  range  from  Congres- 
sional and  DOD  policies  (16:24)  to  day-to-day  problems  at 
the  working  level  (11) . There  appears  to  be  no  easy  solu- 
tion to  many  of  the  program  manager's  problems,  some  of 
which  are  discussed  briefly  in  the  literature  review 
herein,  and  in  detail  in  Chapter  IV. 

One  of  the  significant  problem  areas  currently 
encountered  by  the  program  manager  is  the  proliferation  of 
regulations,  guidance  documents,  and  mathematical  models 
which  must  be  interpreted,  followed,  used,  and  complied 
with  in  the  management  of  the  program  (18) . While  all  of 
the  documentation  contains  important  material  relating 
to  the  concepts  and  techniques  of  life  cycle  costing,  most 
of  the  guidance  presented  is  too  broad  and  philosophical 
for  effective  implementation  by  program  managers  (29: ix). 

As  a result,  there  exists  a real  need  for  a working  level 
document,  oriented  toward  the  one-man  system  program 
office  (SPO) , which  identifies  potential  problem  areas. 
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And  rttlattts  LCC  approach**  which  hav*  b**n  both  auecassful 
and  unauccossful  (11) . 

Stafmant  of  th*  Problam 

Currant  DOD  and  USAF  LCC  faghlationa,  documanta- 
tlon,  and  guidanc*  ara  too  broad  and  philoaophical  for 
affaetiva  uaa  by  tha  managar  of  tha  laaa  than  major  ayatem 
acquiaition  program. 

Raaaareh  Oblactivaa 

Tha  raaaarchara  will  acc«apliah  tha  following 
objactivaa  during  tha  couraa  of  this  effort: 

1.  Identify  potential  LCC  problam  areas  which 
tha  program  managar  may  ancomtar. 

2.  Consolidate  lessons  learned  from  past  and 
on-going  LCC-oriantad  programs. 

3.  Provide  the  basis  for  development  of  an 
improved  and  simplified  LCC  griidance  document  for  the  pro- 
gram managar. 

Scope 

This  thesis  was  written  under  the  sponsorship  of 
tha  Liractorat*  of  Program  Control,  Deputy  for  Aeronautical 
Equipment,  Aeronautical  Systems  Division  (ASD/AE) , Wright- 
Pattarson  AFB,  Ohio.  While  much  of  th*  work  may  be  rele- 
vant to  major  system  acquisition  programs,  tha  research 
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foeuMd  priaarily  on  tho  subsyatam  and  aqulpnant  prograaa 
■anagod  by  tha  AB  SPOa  (aaa  Plgura  1) . 


Particular  attention  waa  given  to  the  one-man  pro- 
gram officea  within  the  AE  "Baaket-SPOa”  which  manage 
aequiaitiona  of  avionica«  life  aupport^  reconnaiaaance , 
atrike#  and  electronic  warfare  equipment. 

The  reaearch  effort  alao  encompaaaed  aeveral  ataff 
officea  within  ASD  and  the  Air  Force  Acqxiiaition  Logiatica 
Diviaion  (APALD)  which  are  concerned  with  varioua  aapects 
of  LCC  aupport  and  impleaientation. 
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CHAPTER  II 


LITERATURE  REVIEW 


EtIv  Proqri  and  Tr«d»off» 

D«spit«  top  l«v«l  «mphasls  on  application  of  LCC 
prlnciplas  and  ganaral  managanwnt  awaranass  of  tha  naad  to 
bring  oparation  and  support  (OaS)  costs  undar  control, 
thara  ara  still  many  working  laval  problams  which  hindar 
succassful  and  aconomical  application  of  LCC  to  rasaarch, 
davalopnant,  and  acquisition  programs.  A raviaw  of  managa- 
mant  litaratura  ravaals  difficultias  in  LCC  application, 
which,  if  ignorad  in  tha  aarly  stagas  of  a program,  will 
graatly  raduca  tha  ultimata  banafit  of  tha  antira  LCC 
philosophy. 

Thara  is  virtually  unanimous  agraamant  that  LCC 
must  ba  appliad  aarly  in  a program  to  achiava  maximum 
af f activanass . This  situation  is  lllustratad  in  Figura  2. 
DOD  Dlractiva  5000.28  on  Dasign  to  Cost  (DTC)  strassas 
aarly  application  of  OTC/LCC  managamant  and  procuramant 
prlnciplas  to  all  programs,  both  major  and  lass  than  major 
(37) . Tha  Joint  Logistics  Commandars  hava  varlflad  tha 
naad  for  aarly  Introduction  of  cost  as  a dasign  paramatar 
and  hava  statadx 
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Fig.  2.  Impact  of  Oosign  Oaclaions  on 
Future  Life  Cycle  Costs  (4:16) 


. . . the  requirements  generation  phase  is  that  in 
which  cost  consideration  can  have  the  greatest  impact. 

In  analyzing  the  possible  ways  of  countering  a threat 
or  of  supplying  a needed  capability,  the  cost  of  each  of 
the  possible  ways  must  be  balanced  against  the  effec- 
tiveness and  affordability  of  each  [33:13]. 

Early  application  of  OTC/LCC  principles  is  recog- 
nized as  a necessity  not  only  by  government  but  also  by 
many  iMustry  authorities  as  well.  Some  representative 
connaents  Include  "Major  coat  reductions  are  possible  only 
when  [LCC/OTC  principles  are]  considered  very  early  in 
advanced  development  [16:24]"  and; 

Because  the  designer  has  a lot  of  leverage  on  the 
ultimate  coat  of  a product— affecting  as  much  as  80 
percent  in  some  cases— a research  and  development  pro- 
gram must  be  given  money  and  attention  early  [6:7]. 

The  above  citations  are  only  a few  of  many  which 
recognise  that  effective  steps  to  LCC  optimization  must  be 
taken  early  in  a program.  As  in  many  other  areas,  however. 
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what  actually  happana  differs  from  tha  stated  intant  of 
nanagsnant  policy.  Typically/  tha  Air  Fores  nanagar  for 
tha  lass  than  major  program  la  asaignad  aftar  most  of  tha 
significant  design  work  on  a systan  ^s  baan  completad. 

Tha  basic  design  has  baan  accomplished  by  an  Air  Force 
laboratory/  by  a research  and  development  contractor/  or 
by  a not<-for-profit  institution.  By  the  time  the  program 
reaches  tha  Air  Staff  Program  Management  Directive  (PMD) 
acquisition  phase/  much  of  the  design  is  essentially  frozen 
Yet  it  is  at  this  time  that  the  acquisition  manager  is 
appointed  and  directed  to  proceed  with  full  scale  develop- 
ment / production , and  deployment  (16:24) . 

The  direction  to  proceed  frequently  imposes  a 
number  of  requirements  in  the  LCC  area/  which/  if  pursued 
conscientiously  by  the  program  manager/  may  force  him  to 
neglect  many  other  iioportant  facets  of  his  program.  A 
typical  example  taken  from  a recent  PMD  for  the  acquisition 
of  a weapons  delivery  system  required  the  program  memager 
to  accomplish  the  following: 

1.  Conduct  a reliability  program  in  accordance  with 
AFR  80-5. 

2.  Assess  and  apply,  as  appropriate,  the  need  for 
a maintainability  program. 

3.  Implement  the  basic  objectives  of  AFR  800-8, 
Integrated  Logistics  Support,  to  the  extent  com- 
patible with  program  size,  resources,  and  contracts 
to  insure  integrated  consideration  of  all  support 
elements . 

4.  Prepare  and  submit  a logistics  supportability 
report/evaluation  to  HQ  USAF  before  contract  award. 


5.  Consider  a posslbl*  raliabllity  iaprovaawnt  war- 
ranty (RIH) . . 

6.  Conduct  all  Lifa  Cycla  Coat  aspacta  of  tha  program 
in  accordanca  with  AFR  800-11,  aa  appropriata 
(35:2-51. 

Thara  ara  two  problama  craatad  by  diractiona  lika 
thoaa  givan  abova.  Firat,  it  ia  difficult  at  baat  for  tha 
program  managar  to  comply  affactivaly  with  tha  voluma 
ifork  raquirad  by  all  of  tha 'diractivaa  (11).  Sacond,  and 
parhapa  mora  important,  tha  diraction  waa  impoaad  aftar  the 
baaic  aquipmant  daaign  waa  complata,  poaaibly  aliminating 
many  chancaa  tha  program  managar  may  hava  had  to  raaka  aarly 
coat-affcctiva  tradaoff  daciaiona  (22:7). 

Racruaat  for  Propoaal  and 
Conteactino  Conaldarationa 

Aftar  aarly  program  and  procuranant  planning  afforta, 

tha  program  managar  bagina  to  atructura  tha  raqpiaat  for 

* 

propoaala  (RFP)  to  ba  aant  to  induatry,  and  to  plan  tha 
ovarall  LCC-baaad  nagotiating  and  contracting  atratagy. 

Tha  USAF  Inapactor  Ganaral  haa  racognizad  tha  problama  con- 
nactad  with  thia  phaaa  and  haa  atatad,  "Efforta  to  davalop 
LCC  procuramant  tachniquaa  for  application  to  contracting, 
although  prograaaing  ataadily,  atill  hava  a long  way  to 
go  (36:4].* 

A critical  conaidaration  at  thia  ataga  ia  tha 
difficult  taak  of  davaloping  or  aalacting  tha  LCC  matha- 
matical  modal  for  contractor  uaa  in  propoaal  preparation, 
and  for  Air  Force  uaa  in  tha  aourca  aalaction  procaaa  (25). 
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Nodals  hav«  proliferated  in  recent  years  to  the  extent 
that  no  one  really  kno«ra  how  aany  iure  available  (8:7). 

SoaM  experts  believe  that  individual  models  must  be  con- 
structed for  each  program  (5:29),  while  others  state  that 
there  are  too  many  models  and  that  a few  standard  models 
should  be  applied  across  the  board  (3:66).  An  approach 
taJcen  by  sosie  program  managers  has  been  to  contract  for 
LCC  modeling  and  evaluation  assistance  with  one  of  several 
contractors  who  possess  extensive  LCC  experience.  This  is 
not  an  easy  decision  for  the  manager  to  make  and  is  influ- 
enced by  program  timing  and  funds.  He  may  be  forced  to 
contract  for  assistance,  however,  if  adequate  expertise  and 
manpower  are  not  readily  available  within  the  Air  Force 
(20). 

After  development  of  a model  structure.  Air  Force 
parameters  and  constraints  such  as  number  of  using  bases, 
maintenance  concept,  and  other  Air  Force-controlled  items 
which  affect  total  costa  must  be  determined  and  quantified. 
This  is  also  a difficult  area,  particularly  if  the  equipment 
is  significantly  different  from  currently  deployed  equip- 
ment and  if  firm  total  production  amounts  have  not  been 
finalised  (8:5). 

As  soon  as  the  program  manager  completes  the  Air 
Force  part  of  the  model  (the  model  structure  and  inputs) , 
all  potential  contractors  should  be  consulted,  even  before 
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RFPs  ar*  issuad.  JU  on*  LCC*‘«xp«ri«nc«d  program  managar 

has  statad, 

Air  Forca/contrachor  intanrchanga  should  bagin  vary 
aarly  in  tha  program.  Tha  LCC  mathodology,  modaling 
tach^quas,  and  eontracttiaX  caaBd.tmants  must  ba  claarly 
dafinad  and  undarstood  as  aarly  ms- possibla  [1:22]. 

SooM  contracting  parsonnal  disagraa  with  this 
approach  on  tha  traditional  grounds  that  contractors  should 
not  hava  advanca  knowladge  of  a procuramant.  Navarthalass , 
tha  limited  axpariance  to  date  validates  tha  wisdom  of 
aarly  contractor  consultation.  Contractor  feedback,  how- 
ever, forces  the  program  manager  to  make  more  difficult 
decisions.  If  more  than  one  contractor  is  under  considera- 
tion, a variety  of  recommendations  and  suggested  changes 
to  the  model  will  be  provided  to  the  manager.  The  manager's 
dilesna  then  becomes  that  of  meshing  the  feedback  into  the 
model  and  RFP,  while  being  equitable  and  reasonable  to 
each  contractor  (20) . 

After  completion  of  the  model  which  will  be  used 
to  evaluate  the  various  contractor  proposals,  the  program 
manager  continues  work  with  procurement  personnel  to 
finalise  the  RFP,  complete  the  evaluation  criteria,  and 
structure  any  LCC  incentive  or  reliability  improvement 
arrangements  to  be  negotiated  with  the  contractor. 

After  release  of  the  RFP  and  subsequent  receipt  of 
the  contractor's  proposals,  the  program  manager  makes  a 
nmsber  of  critical  decisions.  The  proposed  LCC  estimates 
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must  bs  input  to  ths  model  and  evaluated.  The  program 
manager  and  the  source  selection  board,  which  will  vary  in 
sise  and  formality  according  to  program  size,  must  balance 
technical  factors  with  LCC  estimates  (1:21).  If  LCC  is 
to  be  the  prime  selection  criteria,  incentives  and/or 
penalties  may  be  negotiated.  At  this  point  final  arrange- 
ments for  laboratory  or  actual  field  evaluation  and  veri- 
fication of  the  contractors'  estimates  should  be  completed. 
All  of  these  areas  mxist  be  tied  together  into  one  document, 
the  contract,  which  one  authority  has  called  "the  weakest 
link  in  the  management  of  system  acquisition  [32:21]." 

Here  is  where  all  of  the  program  manager's  strategy,  plan- 
ning, and  effort  are  formalized  in  the  contractual  agree- 
ment for  both  the  contractor  and  government  to  sign. 

Award  of  the  contract  does  not  end  the  program  man- 
ager's responsibility.  On  the  contrary,  this  begins  the 
phase  of  the  program  which  will  prove  whether  or  not  all 
the  preceding  effort  was  worthwhile  and  effective. 


Post  Contract  Award: 

Testing  Validation,  and  Support 

In  most  hardware  acquisitions,  avionics  for 
instance,  equipment  is  given  a functional  test  as  it  leaves 
the  contractor's  assembly  line.  If  it  passes  the  test  suc- 
cessfully, it  is  shipped  to  a user  or  to  a depot  for 


storage  and  later  issue.  When  the  equipment  or  component 
is  installed  on  a major  system  such  as  em  aircraft,  it  may 
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not  operate  properly.  Often,  becatiae  of  deficiencies  in 
the  maintenance  reporting  system,  i^e  reason  for  malfunc- 
tion is  not  clear  (25) . The  failure  could  be  caused  by  a 
latent  defect  from  the  contractor's  production  process, 
damage  received  in  shipping,  damage  caused  by  improper 
installation,  or  by  any  of  a nimber  of  other  reasons. 

After  the  defect  has  been  identified,  the  item  is  usxially 
shipped  back  to  the  depot  or  contractor's  plant  for  over- 
haul. Because  the  origin  of  the  malfunction  cannot  be 
proven,  the  government  normally  pays  for  shipping  and 
repair  (2:33,34). 

This  example  Illustrates  another  major  problem  in 
managing  a LCC-based  program.  If  contract  award  is  on  the 
basis  of  lowest  LCC,  and  especially  if  incentives  and/or 
warranties  are  inclxided  in  the  contract,  the  program  mana- 
ger must  incorporate  some  mechanism  for  the  testing  and 
validation  of  the  contractor's  performance  and  cost  com- 
mitments . 

The  importance  of  clearly  defining  and  closely 
monitoring  the  verification  testing  cannot  be  over- 
emphasized. Since  the  test  results  may  require  a sub- 
stantial price  adjustment,  the  validity  of  the  test 
data  must  be  assured  [1:24] . 

It  is  beyond  the  scope  of  this  research  to  recom- 
mend test  procedures  or  specific  test /verification  pro- 
grams , as  these  should  be  tailored  to  the  equipment  and  its 
intended  environment.  The  point  is  to  recognize  that  the 
post-contract  award  phase  is  a critical  aspect  of  the 


progxaaif  requiring  many  months  of  planzU.n9  and  coordina- 
tion by  the  program  manager.  Maintenance  concepts  must 
be  finalised,  test  procedures  and  organizations  must  be 
determined/  maintenance  personnel  must  be  trained,  and 
reporting  channels  have  to  be  determined  and  sometimes 
invented.  The  program  manager  should  be  integrally 
involved  in  all  these  matters,  and  should  start  arrange- 
ments long  before  contract  award  (25).  By  themselves, 
extensive  and  coordinated  planning  efforts  with  all 
involved  systems , operations , and  logistics  organizations 
will  not  guarantee  program  success  and  lowest  possible 
life  cycle  costs.  On  the  other  hand,  lack  of  attention  to 
these  efforts  may  result  in  numerous  problems  and  costs 
that  are  higher  than  necessary. 
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CHAPTER  III 

METHODOLOGY 

Pr#lijninarv  Effort 

This  study  wss  ths  culolnation  of  six  months  of 
rsssareh  effort  into  LCC  principles,  programs,  and  problems. 
General  and  specific  literature  reviews  were  accomplished, 
along  with  lijaited  interviews  with  program  control  and 
program  management  personnel. - The  early  research  examined 
various  aspects  of  LCC  application  to  less  them  major  pro- 
grams and  formed  the  basis  for  in-depth  review. 

The  exploratory  interviews  and  papers  revealed 
a number  of  problem  areas  and  deficiencies  in  the  applica- 
tion of  LCC  principles  which  required  further  research  and 
definition.  From  this  preliminary  research  an  interview 
guide  (Appendix  B)  was  developed  which  was  designed  to 
assist  the  researchers  in  the  following  areas: 

1.  Detect  emd  define  working  level  LCC  problem 

areas . 

2.  Pinpoint  iaq>ortant  lessons  learned  on  past  and 
on-going  LCC-orlented  programs. 

3.  Docunent  both  successful  and  unsuccessful  LCC 
approaches  and  the  circianstances  svirrovmding  each. 
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4.  Identify  oodela,  documentation * and  guidance 
which  have  been  helpful  to  program  managers  and  contracting 
officers  in  inqplementing  LCC  in  the  procurement  process. 

Final  Research'  Effort 

The  core  of  the  research  effort  was  a series  of 
in-depth  interviews  with  exprienced  management  and  pro- 
curement personnel  who  have  been  or  are  now  currently 
involved  in  LCC-based  programs.  The  researchers  utilized 
the  guide  in  Appendix  B as  a general  format  for  conducting 
the  individual  interviews.  The  interviews  were  made  with 
personnel  who  were  identified  by  AE  management  as  being 
or  having  been  actively  responsible  for  or  associated  with 
LCC-orlented  programs.  These  interviews  provided  a sig- 
nificant amount  of  useful  information  from  which  problems, 
solutions,  and  lessons  learned  <u:e  consolidated  and  cate- 
gorized in  Chapter  IV. 

Specific  programs  examined  included  the  following: 

1.  AM/ARC-164  UBF  Radio 

2.  OMEGA  Navigation  System 

3.  F-4  Inertial  Measurement  Unit  (INU) 

4.  Survival  Avionics  System  (SAS) 

5.  AM/ARC-186  VHF  Radio 

6.  B-52/F-15  Tail  Warning  System  (TWS) 

7.  F-16  Carbon  Brake  Improvement  Program 

8.  C-141  Attitude /Heading  Reference  System  (AERS) 


f 
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9.  Advanced  Concept  Ejection  Seat  (ACES  II) 

10.  Electronically  Steerable  Antenna  Syatem  (ESAS) 

These  programs  constitute  the  majority  of  LCC 
efforts  managed  vlthln  AE  to  date.  The  objective  during 
the  Interviews  was  to  discover  both  common  and  unique 
problems  and  solutions  which  might  be  useful  In  the  manage- 
ment of  cturrent  and  future  programs. 

Among  those  Interviewed  were  engineers  and  procure- 
ment personnel,  but  the  primary  focus  was  on  program  mana- 
gers who  have  the  ultimate  responsibility  for  program  cost, 
schedule,  and  performance.  While  the  emphasis  was  on  %ior)c- 
Ing  level  managers  within  AE,  Inputs  from  personnel  in 
relevant  ASO  and  AE  staff  offices  were  also  Incorporated. 

The  researchers  did  not  define  rigid  criteria  for 
the  Inclusion  or  exclusion  of  material  obtained  from  the 
Interviews.  Because  of  the  variety  of  LCC-based  programs 
and  because  of  significant  differences  among  programs.  It 
was  not  anticipated  that  a single  best  approach  to  LCC 
management  would  be  derived  from  the  research.  Rather,  It 
Is  Intended  that  the  consolidation  of  problems  which  have 
already  been  experienced,  lessons  learned,  successes,  fail- 
ures and  recoamendatlons  from  knowledgeable  personnel  will 
supplement  working  level  guidance  and  form  an  Improved 
basis  for  decision  making  by  future  program  managers. 
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CHAPTER  IV 

INTERVIEW  FINDINGS  AND  RESULTS 

Introduction 

This  chapter  is  composed  primarily  of  material 
derived  from  in-depth  interviews  with  personnel  who  have 
had  first-hand  experience  with  some  or  all  phases  of  LCC 
programs.  Most  of  the  individuals  interviewed  were  pro- 
gram managers,  but,  on  some  programs,  test  engineers  and 
contract  negotiators  were  also  contacted.  In  addition. 
Interviews  were  also  conducted  with  personnel  from  the 
Joint  ASD/AFALD  LCC/OTC  Advisory  Group  who  have  been 
involved  extensively  with  a wide  variety  of  subsystem  and 
system  level  programs.  This  chapter  is  a synthesis  of 
those  interviews,  highlighting  the  problems,  solutions, 
infotmation  itasis,  and  lessons  learned  which  may  be  use- 
ful to  future  program  managers.  The  interview  material  is 
tied  together,  where  appropriate,  by  significant  items 
from  documentation  which  may  be  particularly  helpful. 

The  material  has  been  separated  into  various  broad 
sections  for  reference  and  organisation  purposes.  Many 
items  may  not  fit  into  a particular  section,  or  may  seem 
to  fit  into  several,  or  all,  sections.  This  is  a dilenna 
facing  a manager  of  a LCC-orlented  program.  This  also 
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raflttcts  what  la  poaalbly  tha  major  advantage  to  the  LCC 
concept;  that  is,  that  LCC  is  multidisciplinary  and  inter- 
disciplinary  in  natxare.  It  is  difficult  to  clearly  define 
all  of  the  divisions  of  LCC  responsibility.  To  be  effec- 
tive, the  LCC  concept  must  be  applied  as  a management 
philosophy  across  all  phases  of  an  acquisition  program  from 
conception  to  deployment  and  operation.  By  conscientiously 
applying  LCC  principles  and  concepts,  the  program  manager 
and  all  those  who  support  him  are  able  to  achieve  much 
greater  program  visibility  than  has  previously  been  pos- 
sible (23) , and  are  able  to  make  decisions  which  will  pro- 
vide the  required  syst«n  performance  at  minimum  cost  to  the 


government. 


Barlv  Program  Considerations 


Program  Hanager  Coomitment 


Nearly  all  individuals  intervie«red  agreed  that  pro- 
gram manager  commitment  to  the  LCC  management  philosophy 
is  the  key  element  in  effective  application  of  LCC 
principles.  It  is  possible  for  LCC  to  become  a "block- 
filling*  exercise  if  the  program  manager  is  unwilling  or 
unable  to  devote  adequate  time  or  program  resources  to  LCC 
management  (28) . The  program  manager  must  establish  the 
LCC  management  philosophy  within  the  contractor's  organisa- 
tion from  the  beginning  of  the  program.  The  program  manage- 
ment team  should  be  aware  of  tha  fact  that  most  contractors 
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«r«  not  motivatod  toward  LCC  radoetloa.  Contractors  fra- 
quantly  maka  as  noch  or  nora  nonay  fra«  product  support  as 
they  do  froQ  RSO  and  production,  so  LCC  raductlon  by  battar 
daalgn,  siapllflad  sailntananca , and  fawar  spara  parts  is 
not  raally  in  thalr  bast  intarast.  Contractual  ineantlvas 
aay  balp  to  notlvata  contractor  parformanca,  but  Incan- 
tivas  alona  ara  not  tha  answar  (26) . Tha  program  managar 
and  his  tachnieal  and  proeuramant  taams  must  act  togathar 
throughout  tha  antira  lifa  of  tha  program  to  disciplina 
tha  contractor  and  instill  in  him  tha  baliaf  that  USAF 
dacislons  will  in  fact  ba  mads  on  tha  basis  of  lowast  LCC 
within  a raquirad  parformanca  anvalopa.  LCC  should  ba 
formally  introducad  in  tha  concaptual  or  full  scala  davalop- 
mant  (FSD)  phasas  of  tha  program  and  ba  continually  «npha- 
slsad  at  all  dasign  raviaws  and  in  all  contacts  batwaan 
govammant  and  contractor  (39) . 


Tha  Biost  important  principle  of  LCC  is^SSi^^a 
systasi  dasign  process  incorporate  and  focus  on  as  prlxoary 
factors  tha  coats  of  oparationa  and  support  functions. 

Tha  impact  of  diffarant  maintananca  policias  on  program 


costs  should  ba  sariously 


isad  in  tha  concaptual  phase. 


and  by  tha  validation  and  FSD  phases,  logistics  personnel 
should  ba  axtanslvaly  involved  with  structuring  and  design- 
ing program  altamativas  (30) . While  raquirad  by  various 
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DOD  and  OSAF  policy  docTaaonts,  this  area  of  aarly  program 
attention  and  tradeoffs  is  ona  which  most  program  managers 
interviewed  indicated  was  deficient  and  required  increased 
attention.  None  of  the  programs  examined  had  received 

• • «•  a • 

any  significant  Air  Force  Systems  Conmiand  <AFSC)  laboratory 
assistance  r nor  had  any  of  the  program  managers  partici'* 
pated  in  the  conceptual  or  validation  phase  of  their  pro- 
grams. Reasons  for  the  absence  of  participation  vary. 
Probably  the  primary  reason  is  that  acquisition  program 
managers  are  simply  not  Identified  until  the  Air  Staff  deci- 
sion to  proceed  into  PSD  or  production  is  made.  When  they 
are  identified,  they  are  assigned  to  an  organisational 
entity,  AB,  which  is  managed  and  funded  separately  from 
the  laboratories  (11) . 

While  the  laboratories  are  primarily  responsible 
for  developing  and  demonstrating  advanced  concepts,  LCC 
can  never  be  a totally  effective  philosophy  until  the  RSD 
managers  in  the  laboratories  and  the  program  managers  in 
the  acquisition  organizations  develop  more  cooperative  rela- 
tionships and  improved  communication  channels.  This  issue 
of  increased  laboratory  participation  in  early  LCC  appli- 
cation^ls  seen  by  scom  LCC  experts  as  one  of  the  more  sig- 
nificant LCC  problmns  facing  AFSC  and  Air  Force  Logistics 
Cosnand  (AFLC)  management  (14) . 


! 

I 

? 

i. 

s 

} 


. w 


21 


It  has  baan  astlaatad  that  approxinataly  60  to  70 
paroant  of  a program's  Ufa  cycla  costs  ara  drivan  by  Air 
Staff  and  oparational  coonand  managamant  policy.  Thasa 
policy  araas  includa  maintananca  manning  and  skill  lavals, 
maintananca  locations  and  concepts r oparational  basing#  and 
oparational  anvironmant.  If  Air  Staff  and  ASD  managamant 
allow  program  managars  to  challanga  thasa  policy  cost 
drivers  and  make  reasonable  adjustments  and  changes  where 
required#  significant  reductions  in  program  costs  can  be 
achieved  (14).  The  program  manager#  however#  should  not 
assume  that  policy  items  ara  sat  in  concrete;  ha  must  be 
willing  to  explore  different  concepts  and  question  policy 
coat  drivers  when  ha  feels  there  ara  potential  cost  savings 
(26) . Examples  of  possible  policy  and  operational  require- 
ment changes  which  would  reduce  X£C  might  be  as  follows: 

1.  Reduction  in  positional  accuracy  requirement  for 
a navigation  system. 

2.  Combination  of  USAF  intermediate  level  mainte- 
nance with  a reliability  improvement  warranty#  such  as  is 
currently  being  used  in  the  ABRS  program  (24) . 

3.  Relaxation  of  resolution*  or  altitude  require- 
ments for  reconnaissance  equipment. 

4.  Reduction  in  number  of  operating  frequencies 
for  a radar  or  electronic  warfare  system. 
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Thtt  point  h«r«  is  not  ths  dslstion  of  squipment 
psrformsncs  paramsters  actually  naadad  in  tha  oparational 
anvironnant,  but  tha  quastioning  and  dalation  of  dasirabla 
faaturas  which  may  significantly  increasa  program  costs 
without  fulfilling  an  actual  fiald  raquiramant. 


Ccsmonality 

Early  program  dacisions  for  subsystam  conmonality 
among  savaral  aircraft  has  baan  a significant  factor  in 
reduction  of  program  coats  on  savaral  relatively  large  pro- 
grams, most  notably  tha  AM/ARC-164  UHF  Radio,  tha  B-52/ 

P-15  TWS,  and  tha  ACES  II.  Tha  AN/ARC-164  was  designed  as 
a flaat-wida  radio,  replacing  several  different  older  radios 
with  low  mean  time  between  failures  (MTBF)  and  high  main- 
tenance costs.  On  tha  TWS  program,  contractors  ware 
directed,  early  in  PSD,  to  design  high  canmonality  for 
multiple  aircraft  applications.  This  approach  has  resulted 
in  an  estimated  90  percent  coomion  parts  factor  for  all  air- 
craft being  considered  for  the  THS  and  a large  reduction 
in  projected  LCC  (13) . 

Tha  ACES  II  program  also  used  tha  conmonality 
approach  with  a great  deal  of  success.  This  ejection  seat 
will  be  used  in  the  A- 10,  P-15,  and  P-16,  and  considera- 
tion is  being  given  to  include  the  A-7.  This  program 
attempted  to  build  in  the  lowest  possible  LCC  in  the  front 
end.  Although  some  aircraft  had  to  be  modified  to 
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■I  I ninilit  ■ tbm  s«at#  total  costs  to  ths  OSAF  will  bs  lowsr 
bsoaoss  of  ths  eosaonality  approach r which  was  couplsd  with 
a siaqplifisd  design,  long  periods  between  replacement  of 
explosive  ccevonents,  and  use  of  the  sane  training,  spare 
parts,  and  maintenance  approach  across  multiple  aircraft 
systems  (15). 


Design  to  Cost  Goals 

Early  establishment  of  DTC  goals  is  an  important 
management  by  objectives  approach  to  LCC  which  has  been 
used  to  advantage  on  a ntanber  of  programs  (26) . A key 
point  here  is  that  DOD  and  Service  top  management  should 
realise  that  these  goals,  especially  in  the  early  phases 
of  a program,  are  almost  always  ambitious  and  frequently 
unattainable.  The  goals  should  be  viewed  more  as  tools 
with  which  to  gain  control  of  program  costs  by  variance 
analysis  than  firm  targets  which  mxist  be  achieved.  One 
program  which  has  used  DTC  goals  advantageously  is  the  TWS, 
which  tied  cost  goals  originally  set  in  1974  into  a produc- 
tion contract  incentive  arrangement  which  operated  along 
with  a reliability  incentive.  In  this  way  the  program  man- 
agement team  hoped  to  achieve  an  optiiaum  balance  between 
acquisition  costs,  reliability,  and  life  cycle  costs  (13). 
(This  approach  will  be  discussed  in  more  detail  in  the 
Negotiation,  Contracting  and  Incentives  section.)  It 
should  be  noted  that  the  DTC  goals  for  unit  production  cost 
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shottld  b«  a«t  Mrly  in  th*  program,  adjusted  when  necea- 
aery,  and  used  as  management  tools  throughout  the  R«0  and 
acquisition  program  phases  (26) . 
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Identification  of  Cost  Drivers  ’ *■  * • 

Bren  if  the  total  LCC  of  a program  cannot  be  deter- 
sdned,  LCC  principles  and  simulation  models  can  be  used 
advantageously  to  determine  which  components  are  the  high 
coat  drivers  (14) . For  instance,  on  the  F-16  Carbon  Brake 
program,  it  was  determined  that  the  carbon  composite  heat 
stack  was  the  single  big  cost  driver  in  the  entire  brake 
assembly.  Program  management  and  engineering  effort  are 
therefore  bei:^.g  focused  on  cost  reduction  of  the  single 
assembly  of  components  comprising  the  heat  stack  (17). 
Conversely,  many  electronics  programs,  such  as  electro- 
magnetic counter  measures  (ECM)  and  avionics,  may  have  many 
high  cost  items  which  force  life  cycle  costs  to  unacceptably 
high  levels.  But,  if  these  high  cost  components  can  be 
Identified  early,  program  funds  and  effort  can  be  allocated 
to  refinement  of  design  in  these  high  payoff  areas. 

An  example  is  the  previously  mentioned  TWS,  where 
the  program  manager  estimates  that  the  full  scale  develop- 
ment phase  emphasis  on  the  high  cost,  high  maintenance 
coeiponents  has  reversed  the  trend  from  40  percent  acquisi- 
tion costs /60  percent  O&S  costs  back  to  70  percent  acquisi- 
tion/30 percent  0&3  costs  (13).  While  it  is  difficult  to 
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d«t«xBliM  th«  inpact  on  total  program  cost,  this  achieve* 
SMnt  has  the  distinct  advantage  of  bringing  costs  back  to 
the  beginning  of  the  program's  life  cycle  where  they  are 
more  visible  and  more  controllable. 


Maintenance  philosophy  and  approach  are  substantial 
cost  drivers  in  determining  system  LCC,  and  early  and  con* 
tlnulng  exaiaination  of  maintenance  implications  must  be  con 


All  system  design  tradeoffs  shoxild  incor^rate  the 
influences  of  the  tradeoffs  on  system  maintainability 
and  maintenance  philosophies  as  well  as  on  system  per* 
fonaance.  If  system  maintenance  is  thought  of  in  the 
same  way  as  a performance  design  parameter,  it  may  be 
possible  to  design  the  system  to  better  incorporate 
system  maintenance  features  and  approaches  and  also  to 
design  the  system  in  ways  that  reduce  the  cost  of  main* 
tenance  and  thereby  the  total  system  life  cycle  cost 
[30216] . 

Frequently,  allowing  design  contractors  freedom  to  develop 
and  propose  innovative  maintenance  approaches,  rather  than 
freeslng  the  maintenance  concept  early  in  the  program,  will 
greatly  reduce  ultimate  costs  of  ownership.  The  TWS  program 
allowed  contractors  this  freedom,  and  it  presently  appears 
the  U8AF  will  benefit.  One  contractor  proposed  using  the 
standard  USAF  three  level  maintenance  concept,  but  another 
contractor  proposed  a "2*>i  level”  approach  using  a unique 
item  of  flight  line  test  equipment.  The  test  equipment  will 
cost  more,  but  the  possible  reduction  in  flight  line  main* 
tenance  manhours  will  more  than  offset  the  added  equipment 


costs  (13) . Xf  ths  contrsctors  had  bssn  oonstrsinsd  to 
standard  malntsnancs  approaohss,  this  cost  rsduotion  would 
not  havs  bssn  posslbls. 
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Program  Myiacsr  Support  • - - . . 

and  Assistancs 

A eossnon  problsm  oltsd  by  program  managsrs  Intsr- 
vlswsd  was  ths  difficulty  sncountsrsd  in  starting  to  apply 
IiCC  in  ths  managsmsnt  of  thsir  programs.  Evsn  though  lifs 
cycls  costing  has  bssn  smphasizsd  for  a numbsr  of  ysara  by 
DOD  and  DSAF  top  managsmsnt,  most  program  managsrs  found 
littls  docunsntation  or  sxpsrtiss  at  ths  working  Isvsl  that 
providsd  adsguats  assistancs.  This  problsm  was  rscognizsd 
within  ths  last  ssvsral  ysars  by  ASD  and  AFALD.  As  a con- 
ssqusncs,  a joint  LCC/DTC  Advisory  Group  (ACCX)  was  sstab- 
lishsd  in  1977  and  is  prsssntly  functioning  as  a focal  point 
within  ASD  for  LCC  and  OTC  matters.  ACCX  has  consolidatsd 
a LCC/DTC  library,  is  collecting  lessons  learned  on  LCC- 
oriented  programs,  and  is  providing  consulting  services  to 
program  managsrs  in  ths  areas  of  LCC  plans,  cost  Inputs, 
model  selection  and  source  selection  criteria.  Program  man- 
agers who  have  consulted  this  group  report  receiving  a sig- 
nificant amount  of  assistance  in  the  application  of  LCC 
principles  and  procedures  to  their  programs. 
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Nodals  and  Data  Inputs 


On#  of  tha  nost  difficult  problams  a program  mana*- 
gar  facaa  la  tha  aalaction  and  uaa  of  a XX:c  computar  modal. 
Uaa  of  a modal  la  not  abaolutaly  naciaaaary  on  all  programs, 
but  as  programs  Incraaaa  In  hardwara  and  malntananca  com- 
plaxlty,  and  as  tha  numbar  of  conqpating  contractora 
Incraaaa,  tha  uaa  of  a computar  modal  bacomas  almoat  manda- 
tory (28) . 

Thara  ara  many  raasons  why  modallng  la  a complax 
and  difficult  fiald,  aapaclally  for  tha  managar  of  a lass 
than  major  program.  Probably  tha  most  significant  raason 
la  that  many  paopla,  avan  axparlancad  systama  managars 
and  anglnaars,  ara  not  familiar  with  computar  modallng 
tachnlquas.  Anothar  raason  la  tha  prollfaratlon  of  LCC 
modala  In  racant  yaars.  Savaral  yaara  ago,  LCC  modala 
wars  hard  to  find,  but  today's  anvlronmant  has  producad 
mora  modala  than  a managar  with  a small  staff  can  possibly 
avaltiata. 

Anothar  problam  In  tha  cholca  of  modala  la  that 
both  tha  USAF  and  Industry  hava  davalopad  thalr  own  modala. 
Whlla  soma  Industry  modala  ara  suparlor  and  mora  daslrabla 
In  many  raspacts,  tha  program  managar  must  allocata  scares 

^ha  tarm  "computar  modal"  la  usad  to  xafar  to  tha 
sats  of  aquations  which,  togathar  with  cartaln  othar  stata- 
manta,  comprlsa  an  axacutabla  software  pac)cage  (or  com- 
putar program)  (30t44). 
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program  funds  for  tha  right  to  uaa  th«m.  Ua«  of  an 
in-houaa  USAF  modal,  howavar,  may  raqulra  ataff  aaalstanca 
which  is  not  availabla  (12) . 

Tha  purposa  of  this  saction  is  not  to  provide  com- 
prahanaiva  instructions  for  model  salaction,  but  rathar 
to  prasant  soma  ganaral  guidalinas  and  soma  axpariancas 
ancountarad  by  previous  program  managers  which  may  aid 
future  managers  in  the  LCC  modeling  process. 


Purposes  and  Types  of  Models 

Numerous  factors  influence  the  selection  of  a par- 
ticular model  for  a program. 

Tha  most  Important  of  these  is  tha  purpose  or  func- 
tion that  tha  modal  is  intended  to  serve  (i.a.,  to 
predict  costs  or  merely  to  collect  and  aggregate  them 
or  both) . Next  in  importance  ranks  the  phase  or  phases 
during  which  tha  modal  will  be  developed  and  applied. 

This  factor  usually  determines  the  availability  and 
degree  of  detail  of  the  program  data  that  will  be  used 
in  the  model's  calculations  [30:45]. 

All  program  managers  interviewed  which  had  used  LCC 
models  stated  that  they  had  not  developed  new  models  for 
their  programs,  but  rather  had  used  existing  models  and 
modified  them  where  necessary.  The  managers  all  indicated 
doubt  that  an  all-purpose  model  existed  or  could  be  developed 
which  would  satisfy  the  requirements  of  all  programs. 

There  are  at  least  ten  categories  of  models  which 
rould  be  used  in  LCC  programs.  The  program  manager  should 
consider  which  type  is  most  appropriate  for  his  program, 


kL 


29 


and,  in  fact,  ha  may  usa  mora  than  ona  typa  during  tha  vari- 
ous program  phaaas.  Thasa  tan  catagoriaa  ara  as  follows t 

1.  Cost  Factor  Nodal~a  modal  in  which  aach  cost  ala- 
mant  is  aatlmatad  by  multiplying  a kay  waapon 
paramatar  by  a factor  which  is  darlvad  as  a function 
of  Air  Forca  cost  axparianca'’on  similar  waapon  sys- 
tams. 

2 . Accounting  Modal— a sat  of  aquations  which  ara  uaad 
to  aggragata  conponants  of  support  costs,  including 
costs  of  manpower  and  matarial,  to  a total  or  sub- 
total of  lifa  cycle  costs. 

3.  Cost  Estimating  Relationship  Modal— a statistically 
derived  sat  of  aquations  aach  of  which  relates  LCC 
or  soma  portion  thereof  directly  to  paramatars  that 
describe  tha  design,  parformanca,  operating,  or 
logistics  environment  of  a system. 

4.  Economic  Analysis  Modal— a m^al  characterised  by 
consideration  of  tha  time  value  of  money,  specific 
program  schedules  and  tha  question  of  investing 
money  in  tha  near  future  to  radv»a  costs  in  tha  mora 
distant  future. 

5.  Logistic  Support  Cost  Simulation  Model— a modal 
which  uses  computer  simulation  to  datasmlna  tha 
impact  of  an  aircraft's  flying  program,  basing 
concept,  maintenance  plan,  and  spare  and  support 
resources  raqulrwaants  on  logistic  support  cost. 

6.  Reliability  Improvement  Cost  Nodal— a sat  of  aqua- 
tions that  reflects  tha  costa  associated  with  vari- 
ous increments  of  improvement  in  equipment  relia- 
bility. 

7.  Laval  of  Repair  Analysis  Modal— a modal,  that,  for 
a given  piece  of  equipment,  datarminaa  a minimum 
cost  maintenance  policy  frem  among  a sat  cf  policy 
options  that  typically  include  discard  at  failure, 
repair  at  base,  and  repair  at  depot. 

8.  Maintenance  Manpower  Planning  Model— a model  that 
evaluates  the  coat  impact  of  alternative  mainte- 
nance manpower  requirements  or  the  effects  of 
alternative  equipstent  designs  on  maintenance  man- 
power requirements. 

9.  Inventory  Management  Model— a model  that  determines, 
for  a given  aystmn,  a set  of  spare  part  stock  levels 
that  is  optimal  in  that  it  minimises  systsm  spares 
costs  or  minimizes  the  Not  Operationally  Ready 
Supply  (NORS)  rate  of  the  system. 

10.  Warranty  Model— a model  that  assesses  the  relative 
costs  of  having  the  Government  do  in-house  mainte- 
nance versus  having  this  maintenance  performed  by 
contractors  under  warranty  [8:7,8]. 
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Th«  program  managar  should  axamlna  candidata  modala  ^ 

in  light  of  four  charactaristlca t domplatanass * sanaltlvlty,  ^ 

validity / and  availability  of  input  data. 

Coeiplatanaaa  maans  that  tha  modal  should  includa 
all  alanants  of  LCC  which  ara  nacassary  for  tha  dacision 
issua  undar  considaration.  If  a dacision  is  to  ba  mada 
on  tha  total  projactad  LCC  of  a program,  than  tha  model 
should  contain  as  many  alamants  of  cost  as  can  ba  astab- 
lishad.  Xf,  for  inatanca,  only  acquisition  costs  ara 
raquirad  for  a dacision,  than  only  tha  RSO  and  acquisition 
cost  alamants  ara  nacassary. 

Sansitivity  is  raquirad  for  a modal  to  ba  useful 
in  design  trade  studies  and  other  types  of  decisions  which 
conpara  competing  altamativas.  Changes  made  to  input 
paraiaatars  should  ba  evident  in  output  results. 

Validity  refers  primarily  to  user  confidence  in 
tha  output  of  tha  8K>dal.  If  important  decisions  ara  to 
ba  mada  on  tha  basis  of  information  derived  from  tha  modal, 
than  tha  user  should  ba  reasonably  certain  tha  output  is 
reliable  and  accurate. 

ror  a LCC  modal  to  ba  useful,  accurate  input  data 
■net  ba  available.  This  is  one  of  tha  most  frequently 
aneountarad  problems  in  tha  LCC  area.  Tha  bast  modal  avail- 
able is  of  no  use  unless  adequate  and  accurate  input  data 


can  ba  developed  and  utilized  (8x5,6). 
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all  thasa  charaetarlatlca.  Bacauaa  vital  program  daclsions 
af footing  millions  of  dollars#  Important  waapon  systems, 
and  numerous  personnel  are  made  on  the  basis  of  model  out- 
put information,  the  program  manager  should  be  thoroughly 
fasdliar  with  the  characteristics,  strengths,  and  deficien- 
cies of  the  model  or  models  used  on  his  program. 

Neqo^ation  and  Contracting 
Considerations 

When  the  program  manager  has  selected  what  he  feels 
is  the  moat  appropriate  model,  moat  experienced  managers 
believe  that  competing  contractors  should  be  given  the 
opportiaity  to  evaluate  the  model  and  propose  changes  and 
alternatives  before  the  final  model  is  structured  and 
incorporated  in  the  RFP.  This  approach  can  be  used  by 
merely  providing  the  contractors  a copy  of  the  model  docu- 
mentation as  was  done  on  the  AN/ARC-164  program  (25)  , or 
by  including  the  model  in  a draft  statement  of  work  (SON) 
as  was  done  on  the  TWS  procurement  (39) . 

In  any  event,  the  purpose  is  to  thoroughly  educate 
all  contractors  in  the  use  of  the  model  so  that  they  will 
feel  confident  that  they  are  being  evaluated  fairly.  This 
pre-RFP  discussion  approach,  used  also  in  the  SAS  and  AN/ 
ARC- 186  procurements,  appears  to  have  been  very  effective 
because  contractors  have  proposed  changes  which  have 
improved  the  models,  source  selections  have  been  facilitated 
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because  all  contractors  submitted  their  proposals  on  a 
consistent  basis,  and  post-award  conflicts  and  protests 
have  been  minimized  because  all  contractors  knew  they  heu3 
been  evaluated  equally  (28) . 

A problem  that  has  been  encountered  on  at  least 
one  program  Involves  the  proprietary  nature  of  a contractor- 
developed  model  which  was  being  leased  by  the  USAF  for 
Internal  use.  When  It  was  decided  to  provide  this  model 
to  competing  contractors  in  the  course  of  amother  program, 
additional  funds  had  to  be  paid  to  the  model  contractor 
to  compensate  him  for  the  use  of  the  proprietary  aspects 
of  his  model  (23) . This  type  of  problem  can  be  avoided 
by  using  a government-owned  model.  If  one  Is  available. 

If  not,  the  program  manager  should  at  least  be  aware  of 
this  possibility  so  that  he  can  allocate  program  funds 
If  required. 

Another  related  problem  is  model  compatibility 
with  the  contractors’  data  processing  systems.  In  one 
case,  which  resulted  in  a claim  against  the  USAF,  con- 
tractors were  provided  with  a LCC  model  card  deck  and 
directed  to  use  the  model  for  development  of  their  cost 
data  subsilsslon  In  response  to  a RFP.  The  model  was  not 
compatible  with  one  contractor's  computer,  causing  him 
to  incur  additional  costs  to  modify  his  systmn,  which  he 
subsequently  claimed  fron  the  USAF  (39) . The  claim  could 
probably  have  been  avoided  If  a claiise  had  been  included 
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in  th«  RF?  •tatln9  that  any  costs  Incurrad  by  tha  contrac-  | 

* 1 

tor  in  proposal  preparation  and  conputer  modeling  would  ! 

be  borne  by  the  contractor. 

The  Blectronically  Steerable  Antenna  System  program 
has  need  LCC  OKideling  techniques  in  an  innovative  manner. 

Because  of  intricate  electronic  feattires  and  numerous  per- 

foxsMnee  and  design  unXnowns,  difficulties  were  encountered 

in  establishing  a DTC  unit  production  cost  (UPC)  goal.  | 

To  solve  this  problsn,  the  program  manager  obtained  design 

parsBMters  froa  the  contractor  which  were  input  to  the 

A 

RCA  PRICB^ , model  to  develop  a USAF  "should  cost”  estimate.  ! 

I 

This  estimate  was  then  used  to  establish  high,  medium,  | 

and  low  negotiating  targets  which  were  tied  to  a contrac- 

j 

tual  DTC  UPC  not-to-exceed  goal.  The  UPC  goal  was  then  | 

input  to  another  model,  TASC  LCC2,  to  determine  the  total 
LCC  and  to  perform  basing  and  mainteneuvee  concept  trade- 
offs (7) . This  successful  use  of  different  models  for 

I 

different  purposes  indicates  a program  manager  need  not 
become  "locked  in*  to  a particular  model,  but  rather  can 
use  a variety  of  models  throughout  a program  according  to 
his  requirements  and  the  advantages  of  specific  models. 

2 

This  parametric  cost  estimating  relationship  model 
is  leased  by  tM  USAT  from  RCA.  It  has  certain  advantages 
which  have  made  it  the  unofficial  ASD  standard  for  esti- 
mating acquisition  costs  (28) . 
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Sottrc»»  of  Input  Data 

Another  problem  encountered  by  most  program  managers 
interviewed  was  the  difficulty  in  obtaining  accurate,  ade- 
quate data  which  were  sufficient  to  input  to  the  various 
models  used  to  develop  LCC  projections.  There  appear  to 
be  no  quick  and  easy  methods  for  program  managers  to  acquire 
needed  cost  inputs.  Many  general  USAF  and  OOD  publications 
are  available  which  address  cost  estimating  models,  but 
these  usually  tell  the  manager  only  how  to  extrapolate 
from  existing  information  using  techniques  such  as  regres- 
sion analysis,  or  provide  standard  cost  factors,  which 
may  or  may  not  be  adequate  for  modeling  and  contractual 
purposes. 

In  early  program  phases  managers  usually  start 
with  rough  estimates  of  eqtiipment  costs  at  high  levels 
of  aggregation  and  use  simplified  forms  of  cost  estimating 
relationships  (CZRs)  for  estimating  associated  operation 
and  support  costs.  As  the  program  progresses,  the  work 
breakdown  structure  (MBS)  forms  an  integral  part  of  the 
cost  estimating  procedure. 

It  is  the  frame%rork  within  which  the  relationships 
among  individual  system  components  are  defined.  Once 
determined,  the  MBS  provides  a standard  organisation  of 
program  costs  which  serves  as  a basis  for  consistent 
LCC  reporting,  cost  estimating,  and  computer  modeling 
[30*171. 

The  CERs  usually  take  the  form  of  rules  of  thumb 
which  may  at  one  time  have  been  useful  and  accurate,  and 
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nay  still  ba  applloabls  for  sons  typas  of  aquipnant.  For 
advaaead  stata-of-tha>art  avionics r for  instanca,  his^ 
torlcal  data  nay  ba  alnost  usalass  for  astimatlng  costs 
for  aaw  programs  (26) . In  ganaralf  nost  CBRs  ara  %faak 
and  raqnira  isq>rovsBiant.  Bacausa  of  this,  program  managars 
should  ba  cautious  about  placing  too  much  faith  in  astl- 
mates  darlvad  from  than. 

Host  nodal  inputs  are  derived  by  analogy  (26) . 

This  technique  involves  the  examination  of  levels  of  effort 
that  were  required  to  perform  similar  tasks  for  similar 
systems  and  coo^ring  them  to  the  systmn  being  developed. 
Once  levels  of  effort  are  projected,  they  can  easily  be 
converted  to  dollars  or  whatever  basis  is  required  by  the 
model.  This  technique  is  probably  most  useful  in  the  cost- 
ing of  engineering  and  software  development  tasks,  but 
can  ba  appliad  to  many  othar  davelopmant  and  ownership 
cost  Itens  as  well  (30:19). 


Parametric  cost  estimating  equations  and  models, 
which  relate  to  othar  systmn  parameters  such  as  weight, 
power  consumption,  frequency,  and  parts  count,  ara  soma- 
timas  vary  useful.  An  example  la  the  RCA  PRICE  model  pre- 
viously nantioned.  Rowavar,  lack  of  good  historical  data 
in  many  hybrid  electronics  and  advanced  materials  areas 
sosietlmas  limits  the  effectiveness  of  these  methods  (31) . 

In  the  final  analysis,  the  program  manager  must 
seek  out  experienced  people  within  AFSC,  AFLC,  and  the  using 
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comands  who  have  had  applicable  experience  and  who  have 
engineering,  modeling,  and  coeh  estimating  expertise  that 
is  program  related.  There  are  engineers  and  program  mana- 
gers located  at  ASD  and  within  the  APSC  laboratories  who 
possess  extensive  management  experience  that  can  be  tapped 
in  the  acquisition  cost  area.  An  often  overlooked,  but 
frequently  excellent  source  of  cost  experience,  can  be 
the  Air  Logistics  Center  (ALC)  it«A  manager  (IM) . The 
IN  dften  has  years  of  experience  working  with  entire  classes 
of  related  equipeient,  and  can  provide  useful  infoxmation 
relating  to  a variety  of  O&S  cost  elements  (26) . 

Not  being  able  to  obtain  data  from  the  using  cosi- 
mands  can  be  one  of  the  more  serious  prob  lasts  encountered 
by  the  program  manager.  In  order  to  cooplete  a thorough 
Z£C  analysis,  the  program  manager  must  have  reasonably 
firm  information  regarding  maintenance  concepts,  basing, 
flying  hours  and  a multitude  of  other  items.  However, 
especially  in  the  early  phases  of  a program,  the  using 
cosnands  often  cannot  supply  the  infozMtion  because  of 
uncertainties,  and  political  factors  impacting  Continental 
United  States  (CONDS)  and  overseas  basing. 

The  TNS  program  manager,  for  instance,  had  to  deal 
with  two  major  cosiBands,  Tactical  Air  Ccoamnd  (TAC)  and 
Strategic  Air  CcesBand  (SAC),  to  establish  basing  scenarios, 
flying  hour  programs,  maintenance  approaches,  and  aminte- 
nance  manhours.  A major  difficulty  in  working  with  TAC 
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was  th«  abaaxK;*  of  a coosBand  focal  point  fron  which  to 
obtain  cost  infotmation.  SAC,  on  tha  othar  hand,  had  a 
focal  point,  but  problsas  wara  ancountarad  with  sona  of 
SAC'S  clasaifiad  baaing  contingency  plans  (13). 

unfortunately,  this  pattern  is  repeated  on  many 
prograsia.  Sven  whan  tha  operational  comnands  are  coopara* 
tiva,  they  often  have  no  reliable  basis  for  estimating 
O&S  cost  inputs  and  tha  problem  remains  on  tha  program 
manager's  shoulders. 
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Spinoff  Benefits  to  LCC  Modeling 

While  tha  primary  purpose  of  LCC  modeling  is  selec- 
tion of  the  contractor  offering  the  equipment  with  the 
lowest  projected  LCC,  several  program  managers  have  dis- 
covered additional  advantages  to  the  modeling  process. 

A major  benefit  of  a well  structured  model  is  that 
it  can  be  used  to  project  spare  parts  requirements  and 
maintenance  budgets  with  a reasonably  high  degree  of  accu- 
racy. This  is  beneficial  not  only  to  the  AFSC  program 
manager,  but  to  APLC  and  the  using  commands  as  well  (31) . 
Another  advantage  is  that  DTC  goal  tradeoffs  and  the  impact 
of  acquisition  costs  on  downstream  OaS  costs  for  different 
alternatives  can  be  evaluated  by  the  program  managsBMnt 
team.  In  addition,  different  logistics  support  concepts, 
such  as  RIW  versus  DSAF  maintenance  or  flight  line  versus 
intermediate  versus  depot  maintenance,  can  be  balanced 
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against  aach  othar  to  datazmina  tha  most  coat  affactiva 
approach  for  tha  program  managar  to  usa  (23) . 


hnothar  banafit  iMntionad  is  that  of  production 
option  evaluation.  If  option  qv^titias  ara  oontamplatad 
or  ara  includad  in  tha  production  contract,  tha  LCC  modal 
can  ba  usad  to  avaluata  tha  affact  of  axarcising  tha  option 
versus  initiating  a new  procuramant.  Tha  impact  of  option 
axarciaas  on  future  logistics  support  and  spares  require* 
mants  can  also  ba  datarminad  (19). 

Finally,  tha  LCC  modal  can  ba  usad  as  an  integral 
program  control  tool  throughout  tha  life  of  tha  program  to 
measure  various  LCC  goals  and  ailastonas  against  achieve* 
mants  and  revised  program  astiaatas  (23) . 

Haouast  for  Proposal  and  Source  Selection 
RTF  Preparation 

Preparation  of  tha  RFP  for  an  LCC*oriantad  program 
involves  several  considerations  which  ara  different  from 
other  types  of  prograas.  Probably  tha  most  significant 
is  that  tha  OSAF's  intent  to  usa  LCC  as  a source  selection 
criterion  for  development  or  production  should  ba  clearly 
stated  in  the  KFP.  Zn  addition,  all  other  major  source 
sa lection  evaluation  criteria  should  ba  includad,  and  their 
relative  importance  should  ba  indicated  (31) . 

Tha  BK>st  desirable  approach,  time  permitting*  appears 
to  ba  to  provide  a draft  RFP  to  all  competing  contractors. 
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Th«  draft  RFP  should  contain,  as  a minifflum,  sourca  aalac- 
tion  crltarla,  cooqplate  description  and  instructions  for 
the  LCC  model  to  be  used,  contemplated  incentive  or  RZW 
provisions,  and  provisions  regarding  qualification  and/or 
verification  testing  to  be  required  (23) . After  prospec- 
tive contractors  have  had  a reasonable  period  of  time  to 
exasdne  and  evalxxate  the  draft  RFP,  a bidder's  conference 
should  be  scheduled  so  that  all  contractors  axe  given  the 
opportunity  to  present  any  questions  they  may  have  about 
the  RFP  and  the  LCC  approach  to  be  used.  This  insures  that 
all  contractors  will  have  the  same  information  and  will 
be  able  to  submit  their  proposals  on  an  equal  basis.  This 
approach  sometimes  has  the  added  advantage  of  clarifying 
and  improving  the  quality  of  the  final  RFP  by  allowing  the 
program  management  team  to  incorporate  worthwhile  contractor 
suggested  changes  (25) . 

RFP  Flexibility 

As  a general  rule,  the  RFP  should  be  as  definitive 
as  possible,  containing  specific  line  itmns  for  all  Jcnown 
equipment  requirements,  options  for  increased  qtumtities, 
ground  support  equipment  (GSE) , data  items,  reprocurmnent 
data,  %iarranties  (if  required) , and  any  contractor  field 
support  that  is  anticipated.  In  a competitive  LCC  procure- 
ment, thorough  planning  of  the  RFP  is  the  Icey  to  program 
success  at  lowest  LCC.  After  the  production  contract  award, 
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th«  program  la  normally  no  longer  competitive r and  the 
winning  contractor  haa  little,  If  any,  incentive  to  provide 
further  reductiona  to  ownerahlp  coata.  An  apparently  excel- 
lent example  of  thla  approach  la  the^AIi/ARC-186  VBF  Radio, 
which  included  all  of  the  above  mentioned  itema  plua  othera, 
in  what  turned  out  to  be  virtually  a total  package  acquiai- 
tion  (19) . 

On  the  other  hand,  if  the  program  ia  a aole  aource 
procurement,  leaving  requirementa  aa  flexible  aa  poaaible 
may  be  beneficial.  Thia  dependa  greatly  on  the  aire  and 
attitude  of  the  contractor  and  hia  dealre  for  future  buai- 
neaa,  but  if  the  contract  ia  properly  Incentivlzed,  the 
contractor  may  be  motivated  to  develop  and  propoae  innova- 
tive and  more  reliable  dealgn  approachea,  economical  mainte- 
nance concepta,  and  effective  incentive  arrangementa  (7). 

work  Breakdown  Structure 

Contractora  ahould  be  required  to  aubmit  the 
rationale  and  aupporting  information  to  back  up  their  LCC 
eatimatea.  Standardized  bid  formate  which  utilize  a 
detailed  HBS  (provided  in  the  RFP)  can  be  extremely  helpful 
in  ccmparing  contractora*  LCC  eatimatea  and  can  alao  help 
in  aaaeaaing  the  differencea  in  propoaed  LCC  by  pinpointing 
coat  drivera  that  are  unuaually  high  or  low  (25) . If  poa- 
aible the  WBS  ahould  be  tied  into  apeclfic  RFP  line  itema 
which  are  in  turn  tied  into  the  LCC  model  elementa.  The 
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thr««-w«y  correlation  of  WBS  to  RFP  to  model  may  not  be 
totally  possible,  but  the  higher  the  degree  of  correlation 
that  is  achieved,  the  easier  it  will  be  for  the  source 
selection  team  to  evaluate  competing  proposals  (39) . 

LCC  Model 

The  RFP  should  clearly  define  the  objectives  of 
and  the  procedures  for  using  the  LCC  model  in  the  source 
selection  process.  If  a draft  RFP  and  bidders  conferences 
have  been  used,  all  contractors  should  be  well  aware  of 
the  characteristics  and  mechanics  of  the  model  by  the  time 
the  RFP  is  received. 

On  some  earlier  LCC  programs,  bidders  were  requested 
to  specify  their  own  methodology  for  estimating  life  cycle 
costs.  However,  most  recent  programs  such  as  the  ONEGA 
Navigation  System,  the  AN/ARC*‘164,  the  Tail  Naming  System, 
and  the  AM/ARC-186,  have  supplied  the  model  to  be  used  by 
all  contractors.  Generally,  all  program  managers  advocate 
the  use  of  government- furnished  models  because  it  Improves 
the  comparability  of  contractors*  estimates  and  facilitates 
both  contractor  and  OSAF  tradeoff  studies. 

Normally,  two  versions  of  the  model  should  be  used 
in  the  RFP— a simplified  model  and  an  algebraic  model.  The 
simplified  cost  model  sets  forth  the  basic  structure  of 
the  LCC  model  in  simmary,  nonquantitatlve  fashion..  Its 
inclusion  in  the  RFP  is  useful  to  both  government  and 
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contractor  parsonnal  at  highar  lavala  who  do  not  raqnira 
knowladga  of  nodal  dataila  but  who  may  naed  to  ba  acquaintad 
with  ganaral  atructural  faaturas  and  modal  charactarlatica. 
Tha  algabraio  modal « of  coursa/  muat  ba  all-incluaiva  and 
contain  all  modal  aquations  and  complata  definition  of  all 
partlnant  variables  (30:27,28). 

RTP  Data  Blamant  Values 

An  la^rtant  factor  in  tha  RFP  is  tha  complata  list- 
ing and  clear  definition  of  each  LCC  modal  data  alamant. 

Tha  values  of  these  variables  in  tha  cost  aquations  are 
at  least  as  important  as  tha  modal  aquations  themselves 
in  calculating  LCC.  Tha  RFP  provisions  should  specify  tha 
source  of  each  data  alamant,  whether  government- furnished, 
contr actor- furnished,  independent  estimate  (such  as  a con- 
sulting contractor) , or  a value  from  USAF  standard  cost 
factor  manuals.  Tha  contractor- furnished  items  should  ba 
clearly  identified.  For  contractor  convenience  and  bid 
standardization,  blank  tables  containing  government- 
furnished  values  can  be  provided.  The  program  manager  must 
take  extreme  care  to  estimate  costs  as  accurately  as  pos- 
sible for  government-provided  data  to  ensure  valid  model 
output  and  to  be  able  to  defend  against  possible  later  con- 
tractor protests  as  to  data  validity  and  acciuracy. 

The  RFP  should  request  that  contractors  provide 
technical  rationale  which  supports  all  contractor-furnished 
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inputs.  If  possible f the  inputs  should  be  backed  up  by  i | 

1 ' 

actual  preproduction  test  data  for  values  such  as  projected  ! 

component  failure  rates.  The  program  manager  can  expect 

overly  optimistic  model  value  Inputs  from  bidders.  There-  I 

fore#  deterrence  against  bidder  gaming  and  optimistic  bias  \ 

must  be  built  into  the  source  selection  process.  The  RFP  I 

must  specify  values  that  are  detailed  enough  so  that  they 
can  be  screened  and  c«Qpared  by  cost  analysts  and  logis- 
tics personnel  against  an  independent  cost  estimate. 

If  substantial  uncertainty  exists  about  some  of 
the  more  critical  input  variables,  the  RFP  should  require 
that  bidders  submit  more  than  one  estimate,  for  instance, 
the  most  likely  estimate,  plus  pessimistic  and  optimistic 
estimates.  Another  approach  may  be  to  require  a probabil- 
ity distribution  of  possible  values.  Since  this  additional 
data  can  be  expensive  and  time-consuming  to  collect  and 
verify,  the  RFP  should  require  submission  only  if  the  pro- 
gram manager  is  reasonably  certain  it  can  be  used  in  source 
selection  or  other  impoxtant  program  decisions  (30:29,30).  | 

I 

Source  Selection  j 

f 

The  primary  objective  of  LCC  analysis  during  the  1 

: i 

source  selection  process  is  to  provide  the  source  selection 
authority  (SSA)  logistics  support  cost  visibility  in  his 
decision-making  process  (23) . The  specific,  objectives  of 
LCC  analysis  are  to: 
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1.  Verify  the  aceureey  of  the  contractors'  LCC  cal- 
culations i 

2.  Verify  that  a common  interpretation  of  the  LCC  pro- 
visions of  the  offerors  in  constructing  their  LCC 
proposals  has  been  achieved; 

3.  Disclose  the  relative  differences  in  the  calculated 
LCC  and  support  costs  of  the  contractors  [30:41]. 

Accomplishment  of  these  objectives  requires  the 
assembly  of  personnel  who  possess  a broad  range  of  expertise 
in  program  management,  material  management,  engineering, 
cost  analysis,  procurement,  and  contract  law.  On  the  AN/ 
ARC- 164  source  selection,  for  instance,  the  Source  Selection 
Evaluation  Board  (SSEB)  was  divided  into  teams  for  pricing, 
technical,  contracts  and  legal,  reliability,  maintainability, 
quality  assurance,  production,  and  life  cycle  costing.  The 
LCC  team  was  considered  unique  in  that  it  had  to  work 
closely  with  most  of  the  other  teams  to  effectively  evalu- 
ate the  reasonableness  of  the  contractors'  LCC  proposals. 
Since  LCC  was  the  major  factor  in  selection  of  the  produc- 
tion contractor,  the  role  of  the  LCC  team  was  critical  in 
the  source  selection  process  (1:7). 

Use  of  LCC  as  a source  selection  criterion  is  of 
little  value  in  motivating  contractors  to  propose  designs 
and  approaches  which  will  minimize  ownership  costs  unless 
they  are  convinced  the  USAF  can  distinguish  between  high 
and  low  LCC  alternatives  (9:13.4).  Two  approaches  which 
have  been  apparently  beneficial  in  motivating  contractors 
are  independent  cost  and  reliability  estimates  and  LCC  team 
visits  to  contractor's  plants. 
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Th«  independent  cost  and  reliability  prediction  i 


estiaates  may  be  accooplished  by  either  in-house  QSAF  teams 
(which  are  separate  from  the  source  selection  teams— for 
Instance,  a team  from  one  of  the  |^s) , or  by  a consulting 
contractor  on  contract  to  the  program  office.  The  point 
is  that  the  contractors  should  be  made  aware  that  their 
proposals  will  be  Independently  evaluated  by  at  least  one 
group  that  is  completely  separate  from  the  SSEB.  This 
approach,  used  on  several  programs  such  as  the  AN/ARC-164 
and  the  F-4  IMU,  is  effective  in  providing  increased  visi- 
bility to  the  SSA  and  in  motivating  contractors  to  provide 
accurate  information,  since  they  know  they  will  be  evalu- 
ated by  multiple  organisations  (31) . 

The  other  approach  was  used  during  the  TWS  FSD 
phase.  While  contractors  were  finalizing  designs  and  pre- 
paring proposals  for  the  production  contract  award,  the 
LCC  team  from  the  SSEB  was  sent  to  the  competing  contrac- 
tors' plants  to  evaluate  reliability  and  maintainability 
factors,  design  approaches,  and  other  LCC  aspects  of  the 
procurement.  This  provided  high  visibility  to  the  govern- 
ment's Intent  to  use  LCC  as  a major  award  factor  and  very 
likely  provided  further  motivation  to  the  contractors  to 
propose  their  lowest  LCC  designs  (13) . 
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LCC  T>Mtt  Formation 


AssMibllng  a compatant  LCC  taan  to  avaluata  con- 
tractors' proposals  is  a critical  alamant  in  tha  sourca 
aalaction  procass.  This  taan  should  includa  not  only  cost 
and  aodaling  axparta,  but  also  raliability  and  maintain- 
ability anginaars,  and,  if  hardwara  is  availabla,  actual 
"hands-on*  maintananca  parsonnal  fron  AFLC  and  tha  using 
conmands  (25).  In  any  avant,  tha  goal  of  tha  program  mana- 
gar  should  ba  tha  assambly  of  a team  that  is  capabla  of 
indapandant  varification  and  analysis  of  all  aspacts  of 
tha  contractors'  proposals.  If  tha  dasirad  parsonnal  are 
not  availabla  within  tha  USAF,  consideration  should  be  given 
to  obtaining  assistance  from  an  independent  contractor  who 
specialises  in  modeling,  reliability  analysis,  or  whatever 
aspect  of  LCC  evaluation  expertise  the  program  manager 
requires  (39) . This  may  create  a significant  drain  on 
scarce  program  resources,  but  unless  tha  USAF  can  condxict 
accurate,  indapandant  analyses  of  contractor  proposals, 
tha  advantages  of  LCC  competition  are  lost. 

Evan  after  source  selection,  the  LCC  team  has  proven 
helpful  to  some  program  managers  by  performing  as  consult- 
ants on  various  aspects'  of  LCC,  such  as  engineering  change 
proposal  (ECP)  evaluation  and  maintananca  problem  analysis, 
during  production  and  field  verification  testing.  Keeping 
tha  team  together  has  been  a significant  problem,  as  most 
members  are  normally  given  new  assignments  after  source 
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««l«etion  has  baan  eonplatad.  Prograa  managars  should 
mttmfit  to  aalataln  taam  Idantlty,  possibly  on  a part-tlaa 
basis,  at  laast  until  tha  conplation  of  varification  tast- 
ing, baeauaa  suwy  LCC-ralatad  quastions  and  problsns  eon- 
tinua  to  ba  aneountarad  throughout  tha  program  managanant 
procass  (13) . 


WaqotiatiCTa#  Contrytino*  and 
Incantiva  Consldarations 

Canaral 

Signatura  of  tha  contractual  document  by  tha  govam- 
mant  and  tha  contractor  culminatas  long  months,  avan  yaars, 
of  affort  on  tha  part  of  tha  USAP  program  managamant  taam. 
Tha  contract  spacifias  both  govammant  and  contractor  obli- 
gations which  must  ba  fulfillad  to  ansura  tha  program's 
objactivas  ara  achiavad. 

Tha  succass  in  implamanting  lifa  cycla  cost  procura- 
mant  dapands  to  a graat  axtant  upon  rigorous  discipline 
in  carrying  out  tha  govammant 's  obligations.  Thasa 
obligations  ara  significantly  graatar  than  a contract 
for  tha  sama  aquipmant  that  doas  not  contain  lifa  cycla 
cost  procuramant  provisions.  Tha  importance  of  asttib- 
lishing  and  maintaining  credibility  caxmot  ba  ovar- 
asiphasisad.  In  fact,  the  enforceability  of  life  cycla 
cost  contractual  provisions  ara  contingent  upon  tha 
govamswnt  carrying  out  its  obligations  [9s  15.1]. 

Tha  final  fozm  of  tha  contract  will  ba  contingent 
upon  many  factors  sxich  as  tha  competitive  situation,  com- 
plexity of  equipment,  maintenance  approach  (i.a.,  depot 
versus  RZN) , incentive  provisions , and  qualification  and/or 
varification  testing  raquirsmants . Ensuring  that  tha 
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contract  thoroughly  and  complataly  spacifias  what  is 
axpactad  of  tha  contractor  whlla  pfotactlng  govammant 
intarasta  ia  particularly  critical  in  a LCC  procurwaant. 
Noxnally,  onca  tha  production  contract  ia  aignad,  tha  pro- 
gram ia  no  longer  compatitiva  and  tha  contractor  haa  no 
further  incantiva  to  raduca  tha  USAF'a  ownarahip  coata 
bayond  what  ia  raquirad  by  tha  contract. 

Contract  Proviaiona 

Each  contract  muat  ba  organized  according  to  ape- 
cific  program  raquiremanta.  Tha  AM /ABC- 16 4 contract  is 
a good  example  of  a program  which  uaed  a logical  contract 
methodology  and  organization  to  implement  LCC  objectives. 
The  AM/ABC-164  contract  was  divided  into  eight  parts  for 
ease  of  management  and  administration  as  follows: 

1.  Overview 

a.  General  statement  of  LCC  objectives 

b.  Definitions 

c.  Engineering  change  proposal  provisions 

2 . LCC  Modal 

a.  Simplified 

b.  Alg^raic 

3.  Verification  Test  Program 

a.  Procedures  for  measurement 

b.  Failure  defixxitions 

4.  Price  Adjxistmant  Provisions 

a.  Positive  and  negative  incentives 

b.  Procedures  for  adjustment 
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5 .  Option  Provision 


i 


a.  Idantification  of  each  replaceabla  unit 

b.  Unit  pricas  and  failura  ratas 

e.  Option  for  procuremant  of  units  at  fixad 
pricas 

6.  work  Braakdown  StructiUra'  ' 

a.  Standard! sad  nathodology  for  making  LCC 

astimatas 

b.  Componant  idantification  at  various  levals 

^ of  datail 

c.  Item /componant  removal  and  repair  informa- 

tion 

7.  Govammant  Furnished  Data 

8.  Corporate  Commitment  Certification 

a.  Required  signature  of  high  level  official 

b.  Ensured  corporate  awareness  of  LCC  pro- 

cxirement  (1:9,10). 

Of  course,  not  all  programs  will  have  the  same 
organization  and  provisions,  but,  because  of  the  unusual 
ccmplexity  of  many  LCC  procurements,  a well  organized  and 
complete  contract  will  facilitate  administration  and  inter- 
pretation of  contract  requirements. 


Intrinsic  Program  Incentives 

The  use  of  incentive /penalty  arrangements  or  relia- 
bility improvement  warranties  varies  greatly  according  to 
individual  program  requirements.  At  least  four  current 
programs  have  followed  the  general  philosophy  that  incen- 
tives are  not  required  if  LCC  is  emphasized  early  and  built 
in  during  the  front  end  of  a program.  These  programs  have 
all  followed  somewhat  different  approaches. 
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Thtt  program  office  managing  the  F-16  Carbon  Brake 
improvement  haa  awarded  relatively  amall  development  con- 
tracta  to  all  major  military  wheel  and  brake  suppliera. 

Bach  contractor  la  deaigning  and  providing  an  improved  ver- 
aion  of  the  carbon  compoaite  heat  a tack  for  the  brake  aeaem- 
bly.  Teata  are  being  conducted  on  both  the  F-16  flight 
teat  aircraft  and  on  the  Air  Force  Flight  Dynamica  Labora- 
tory dynamometet  to  derive  a projected  number  of  landinga 
for  each  competing  brake.  At  the  concluaion  of  the  test 
program  a production  competition  will  be  conducted.  At 
thia  point  the  only  contractor  input  to  the  USAF  LCC  model 
will  be  a unit  production  coat  for  each  brake  assmnbly. 

From  the  CPC  provided  by  the  contractors  and. the  USAF- 
derived  number  of  landings  per  braUce  assmnbly,  the  USAF 
will  be  able  to  award  a long-term  production  contract  based 
on  lowest  LCC.  The  incentive  for  the  competitors  is  to 
design  the  most  economical  brake  possible  because  of  the 
tramendcus  future  business  potential  in  the  F-16  program 


The  Advanced  Concept  Ejection  Seat  development 
relied  on  competition  during  the  FSD  phase  to  provide  the 
incentive  for  design  refinements  and  innovations  which  mini- 
mised otmership  costs  on  this  equipment  which  is  common 
to  the  A-10»  F-15»  and  F-16.  The  program  management  team 
believed  that  the  combination  of  early  competition  and 
production  business  potential  provided  sufficient  motivation 


to  tho  oontraotora  and  that  fozaal  incantivas  in  tha  produc- 
tion contract  would  not  significantly  raduca  costs  (IS) . 

Tha  r-4  Xnartial  NaasurasMnt  Onit  program  manager 

also  used  cosq^tition  during  tha  PSD  phase  to  ensure  lowest 

• ••  ^ ♦ 

LCC.  A slightly  different  concept  used  on  this  program, 
however,  was  the  addition  of  an  unusually  rigorous  Produc- 
tion Reliability  Teat  (PRT)  which  each  production  unit  must 
pass  before  government  acceptance.  The  PRT  is  a fifteen- 
cycle  test  which  includes  acceleration,  temperature,  humid- 
ity and  vibration.  The  assumption  is  that  if  the  equipment 
can  pass  the  PRT,  it  can  withstand  almost  any  condition 
encountered  in  the  field  during  its  design  life.  Since 
each  unit  must  pass  the  test,  the  contractor  cannot  "gold 
plate”  the  test  units. 

Infant  snrtality  is  also  a factor,  in  that  units 
with  latent  manufacturing  defects  are  normally  discovered 
early  as  a result  of  the  PRT.  The  incentive  in  this  con- 
tract is  that  the  contractor  must  do  good  design  work  and 
produce  an  extremely  rugged  unit  to  pass  the  PRT;  otherwise 
he  is  not  reimbursed.  The  DSAP  has  no  contractual  responsi- 
bility to  accept  a unit  until  the  PRT  is  passed  as  witnessed 
by  a U8AP  or  Defense  Contract  Administration  Services  (OCAS) 
Inspector  (31) . 

Finally,  the  Survival  Avionics  System  is  a program 
which  will  apparently  achieve  a low  LCC  without  the  use 
of  incentives.  While  the  prime  contract  for  this  program 
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was  not  cooipstitivs»  the  subcontract  for  the  survival  radio 
portion,  the  high  cost  driver,  will  be.  Low  LCC  will  be 
achieved  by  placing  continual  emphasis  on  design  refine- 
ments in  the  early  program  and  by  retaining  competition 
on  the  hi^  cost  subsystem  (23) . 

While  it  is  not  possible  to  build  in  minimisn  LCC 
at  the  front  end  of  many  programs,  program  managers  should 
emphasise  early  design  tradeoffs  and  other  LCC-reducing 
actions  whenever  possible.  This  is  a key  concept  which 
requires  the  following  elements: 

1.  Program  manager  dedication 

2.  Time  to  make  refinements  and  tradeoffs 

3.  Pimds  to  invest  in  early  design  work 

4.  Low  LCC  design  objectives 

5.  Top  management  support 

6.  Constant  communication  with  the  contractor (s) 
emphasising  LCC  reduction  objectives  (23) . 

If  minimum  LCC  is  designed  into  hardware  early, 
acquisition  costs  are  usually  increased,  but  06S  costs 
and  LCC  can  be  decreased  as  a result.  Additionally,  com- 
plicated incentive  arrangmnents  and  field  verification  test- 
ing uy  not  be  required,  fiurbher  reducing  costs  to  the 
government. 

Incentive  and  Penalty  Arrangements 

Contractual  arrangements  in  which  the  contractor 
is  either  rewarded  or  penalized  monetarily  for  meeting  or 
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missing  cost  and/or  porfozmance  goals  ara  widely  debated 
within  DOD  and  industry.  Incentive  effectiveness  appears 
to  vary  widely  according  to  type  of  program,  competitive 
climate,  business  potential,  and  many  other  variables. 

SosM  prograsw  have  intrinsic  characteristics  which  makes 
the  use  of  special  incentives  unnecessary.  Other  programs, 
however,  seem  to  require  reward  and  penalty  features  to 
motivate  contractors  to  achieve  cost  and  perfoxsiance  tar- 
gets. Instead  of  attempting  to  present  firm  decision  rules 
for  the  use  or  non-use  of  incentives  in  LCC  contracting, 
there  are  some  general  considerations  which  experienced 
program  management , contracting,  and  cost  analysis  person- 
nel have  shared  with  the  researchers. 

1.  Incentive  and  penalty  arrangements  are  the  best 
approach  to  LCC  contracting,  especially  if  a large  per- 
centage of  program  costs  are  O&S  (28) . 

2.  If  OSS  costs  are  S to  10  percent  of  total  pro- 
gram costa,  incentive  arrangements  directed  at  reducing 
OSS  costs  are  probably  not  req\iired.  Instead,  program  man- 
agement effort  should  be  directed  towaird  driving  down 
acquisition  costs  (28) . 

3.  If  projected  equipment  NTBF  is  greater  than 
approximately  400  liours,  especially  for  subsystems  and 
equipment  on  fighter  type  aircraft,  then  OsS  costs  will 
not  be  a very  significant  percentage  of  the  program  costs. 
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ThM:«for«»  DTC  OPC  inc«ntiv«a  ar«  probably  mora  affactiva 
(31). 


I 


I 

I 
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4.  Poaltiva  lacantivaa  ara  not  usually  affactiva 
contractor  awtlvators.  Tba  possibility  of  a larga  penalty 
will  provide  aora  aotivation  than  any  other  factor  (39) . 

5.  Xnoantivas  sesMtifflas  help  to  motivate  contrac- 
tors toward  sdniniaing  LCC»  but  incentives  alone  ara  not 
the  answer.  Program  managers  must  establish  an  LCC  manage- 
ment philoaphy  within  the  contractor's  management  structure 
and  the  entire  program  management  team  must  continually 
provide  LCC  discipline  (26). 

6.  Negative  incentives  are  generally  more  powerful 
in  smaller  subsystem  and  equipment-level  programs.  Posi- 
tive Incentives  are  generally  more  influential  in  major 
system  programs  (26). 

7.  Contractors  "game"  themselves  out  of  positive 
Incentives  and  protect  themselves  against  negative  incen- 
tives. They  bid  based  on  the  probability  of  obtaining 
future  business  at  least  risk  (26) . 

The  AN/ARC-164  program  is  one  which  pioneered  the 
use  of  positive  and  negative  incentives  on  LCC  procurements < 
Contractors  were  allowed  to  propose  both  an  acquisition 
cost  and  a guaranteed  04S  cost-to-the-USAF  total.  If  the 
contractor  is  successful  in  increasing  equipment  MTBF  such 
that  ultimate  0«S  costs  are  reduced,  then  the  contractor 
will  receive  a share  of  the  saved  costs.  Conversely,  if 
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OtS  costs  STS  grsstsr  thsn  guaranteed , the  contractor  will 
ba  penalised.  This  sharing  arrangement  is  shown  in 
Figure  3. 

It  now  appears  that  the  contractor  bid  at  a point 
(90  percent  acquisition  costs /lO  percent  OtS  costs)  where 
it  will  be  almost  Impossible  to  achieve  the  positive  incen- 
tive area.  However,  the  design  effort  was  adequate  to 
achieve  a very  high  MTBF,  which  is  now  approximately  2200 
hours,  and  which  insures  the  contractor  will  not  be  penal- 
iasd.  Although  the  contractor  apparently  did  not  receive 
motivation  from  the  positive  incentive,  the  USAF  did  pro- 
cure what  is  evidently  a superior  system  at  a low  LCC.  On 
this  basis,  the  positive /negative  incentive  approach  on 
this  program  must  be  judged  a success  (10) . 

The  Electronically  Steerable  Antenna  System  program 
is  pursuing  a different  incentive  approach  which  appears 
^ promising.  To  insxire  adequate  contractor  attention  to  LCC, 

^ a reliability  incentive  was  negotiated  into  the  ;on- 

I tract.  To  guard  against  oversmphasls  on  a high  MTBF  design 

i and  resulting  acquisition  costs  which  are  excessive,  the 

I 

reliability  incentive  was  coupled  with  a DTC  UPC  goal. 
Specifically,  to  achieve  an  optimum  tradeoff 
^ between  acquisition  costs,  reliability,  and  LCC  the  prog- 

gram  management  team  first  deteimined  the  optimtm  range 

I for  design  MTBF.  This  was  done  by  comparing  estimated 

j ■ 

acquisition  costs  versus  0&S  costs  over  a wide  range  of 


POSITIVE  IHCBNTIVB 


Pig.  3.  AN/ARC- 164  Incentive  Provision  (5:31) 


MTBrs.  This  coaparison,  shown  in  gsnsrslissd  foxa  in 
Pigurs  4,  produesd  s total  cost  "flat  spot*  batwaan  tha 
NTBF  points  shown  as  and  R^.  R^^  and  R^  wars  than 

incorporatad  into  tha  contract  as  an  NTBF  ranga  which  tha 
contractor  must  achiava  and  daaonstrata  in  a U8AF  aonitorad 
Isboratory  tast.  Tha  NTBF  achiavad  is  incantivisad  by 
ralating  tha  numbar  of  failures  axpariancad  during  tha  tast 
to  tha  amount  of  faa  aamad  by  tha  contractor.  Thara  is 
no  nagativa  incantiva^  as  such,  in  tha  contract;  howavar, 
tha  contractor  racaivas  no  faa  unless  both  tha  NTBF  and 
ore  goals  ara  raachad  (7) . 


COHTRACTUALLY 
BOUNDED  NTBF 
^ RANGE. 


fACQUISI- 
TION  COST 


RELIABILITY  (NTBF) 


ESAS  Program z Relationship  Batwaan  Cost 
and  Reliability  (7) 


A hl^ily  promising  Mgfttiv*  lnc«ntlv«  is  b«ing  us«d 
on  tho  AR/AnC-186  VBF  radio  program.  Tha  U8AF  apaelflad 
a minimum  aeeaptabla  NTBF  in  tha  production  RFP  with  no 
vpaeifiad  uppar  limit.  Contraetora  wara  allowad  to  proposa 
any  NTBF  abova  tha  minimum,  but  tha  bid  NTBF  waa  raquirad 
to  baa  guarantaad NTBF  at  aquipnant  maturity.  For  aourca 
aalaction,  tha  guarantaad  NTBFa  and  tha  propoaad  acquiai- 
tion  coat a for  aach  biddar  wara  input  to  tha  USAF  modal 
to  dariva  tha  lowaat  LCC.  To  inauura  contractor  ccmplianca 
with  tha  guarantaad  NTBF,  tha  contract  containa  a penalty 
clauaa  which  atataa  that  tha  contractor  will  aupply  tha 
USAF  with  aattlamant  aparaa  and  raimburaa  tha  USAF  for  tha 
additional  maintananca  coata  raaulting  from  a lower  than 
guarantaad  NTBF.  Tha  achieved  NTBF  will  ba  maaaurad  in 
a fiald  verification  teat  to  ba  conducted  with  aamplaa  from 
tha  firat  two  yaara  of  productipn  (19) . 

It  ahculd  ba  noted  that  thia  approach  ia  normally 
affective  only  if  tha  program  ia  compatitiva.  Sola  aourca 
contraetora  will  aaldom  agree  to  penalty  arrangamanta  unlaaa 
other  faetora,  aueh  aa  peripheral  eontracta  or  aignif leant 

I 

future  buainaaa,  are  praaant. 

Tha  Tail  Naming  Syatam  program,  which  ia  in  pro- 
duction aourca  aalaetion  at  thia  writing,  ia  aatabliahing 
a poaitiva/nagativa  incentive  arrangement  that  la  almilar 
in  aama  raapaeta  to  tha  BSAS  diaeuaaad  pravloualy.  Tha 
production  contract  award  will  ba  baaed  on  lowaat  LCC,  but 
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LCC  will  not  b«  incontlvized  as  such  bacause  of  verlflca-  ' 

tlon  tasting  problems  in  the  SAC  operational  environment.  ^ > 

Instead,  both  reliability,  based  on  laboratory  demonstra- 
tion  of  MTBP,  and  OTC  goals  are  incentivised  in  such  a way 
that  the  contractor  should  be  motivated  to  produrse  the 

1 

equipment  at  minimum  LCC.  Specifically,  the  DTC  goal, 
originally  established  during  FSD  in  1974,  drives  the  base 
profit  rate  to  be  realized  in  the  production  contract.  The 
base  profit  rate  will  be  adjusted  1.4  percent  for  each 
$10,000  Increment  the  contractor  produces  adxdve  or  below 
the  OTC  UPC  goal  with  a maximum  adjustment  of  + 4.2  per- 
cent and  a meucimum  possible  profit  of  15  percent.  Without 
the  type  incentive  aurrangement , the  maximian  profit  usually 
negotiated  on  this  type  of  contract  would  be  in  the  area 
of  10  to  12  percent. 

To  protect  against  contractor  overemphasis  on 
reaching  the  OTC  goal  at  the  expense  of  reliability,  final 
profit  will  also  be  adjusted  in  accordance  with  the  arrange- 
ment shown  in  Figure  5. 

The  contractor  will  gain  an  additional  $100,000 
for  each  demonstrated  ten-hour  increment  over  the  MTBF 
target  of  200  hours  to  a maximum  of  250  hours.  On  the 
penalty  side,  the  contractor  will  loose  $500,000  for  each 
ten  hours  below  the  minimum  acceptable  MTBF  of  150  hours. 

Achieved  MTBF  will  be  verified  by  a laboratory  test  of 
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RELIABILITY  (HIBF) 


Fig.  5.  TWS  MTBF  Incttittive  Provision  (13) 

two  units  randonly  sslsctsd  from  ths  first  production  run 
of  40  plus  a raliability  accaptanee  tast  on  aach  production 
unit. 

This  coabination  of  incantivas  providas  significant 
motivation  to  tha  contractor  to  raduca  tha  UPC  while 
increasing  tha  systam  MIBF.  However,  if  technical  or  pro- 
duction problsns  are  encountered,  tha  contractor  has  tha 
overriding  incentive  to  reach  tha  NTBF  target  because  of 
the  extresMly  high  penalty  cost  (13).  Again,  it  should 
be  noted  that  a conpetitive  situation  is  required  to  enable 


th«  08AF  to  nogotiat*  panalty  clausaa  of  thia  typa  and 
■agnltnda. 


Kallabilitv  iMprovaaant  Warrantiaa 

RallabiXity  istprovamant  warr^tiaa  ara  not  noxnally 
thought  of  as  an  approach  to  minimizing  the  LCC  of  a pro- 
gram. Ohdar  soBM  circumstances,  however,  RIWs  can  provide 
significant  motivation  to  contractors  to  improve  equipment 
design  and  provide  economical  support  which,  in  turn, 
reduces  USAF  ownership  costs.  Program  managers  should 
strongly  consider  the  advemtages  and  disadvantages  of  using 
a RZW  approach  before  making  final  logistic  support  deci- 
sions. 

While  organic  maintenance  offers  significant 
advantages,  such  as  in-house  maintenance  capability,  pro- 
tection against  strikes,  increased  control  of  assets  and 
ability  to  accelerate  operations  under  emergency  conditions, 
the  RIW  approach  also  provides  substantial  advantages: 

1.  Strong  contractor  incentive  to  improve  field 
reliability. 

2.  Possible  reductions  in  USAF  maintenance  and 
support  personnel. 

3.  Deferred  support  equipment  decisions. 

4.  Less  data  (technical  orders,  parts  breakdowns, 
etc. ) . 

5.  Fixed  maintenance  costs  for  the  duration  of 
warranty. 

6.  Greater  protection  to  the  USAF  if  equipment 
has  low  reliability  (21) . 
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Two  programs  that  ara  currantly  .using  RIWs  ware 
axamlnad.  The  OBOGh  Navigation  System,  which  was  a competi- 
tive program  through  FSD  with  a production  contract  award 
based  on  lowest  LCC,  now  has  almost  two  years  of  field 
experience.  The  OMEGA  production  contract  requires  the  i 

contractor  to  fxxlfill  the  following  obligations: 

1.  Maintain  and  update  maintenance  records. 

2.  Reach  specified  increasing  MTBF  goals  during 
the  warranty  period  at  sei^annual  assessment 
reviews . 

3.  Accomplish  no-cost-to-the-USAF  engineering 
changes  to  reach  the  required  MTBF. 

4.  Perform  all  required  maintenance  within  a 
specified  turnaround  time. 

5.  Provide  and  manage  all  spare  parts. 

6.  Provide  consignment  spares  if  MTBF  commitment 
is  not  reached  (27) . 

Experience  to  date  indicates  the  contractor  is 
meeting  the  required  obligations,  although  the  USAF  has 
had  some  problems  in  fulfilling  its  contractual  guarantees. 

Specifically,  the  USAF  provided  estimates  on  the  number  of 
equipment  Installations  and  flying  hours  to  the  contractor 
which  formed  the  basis  for  the  contractor's  JCrBF  commit- 
ments and  maintenance  workload  projections.  Because  of 
slippage  in  aircraft  modifications  at  the  cognizant  ALC, 
and  subsequent  reductions  in  flying  hours  below  the  USAF 
projections,  various  contractual  modifications  have  been 
required  to  allow  the  contractor  more  time  to  reach  his 
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NTBF  go«l.  Impact  of  the  slippage  has  not  baan  vary  sig- 
nificant other  than  increasing  administrative  workload  and  i 

delaying  deployment  of  needed  equipment  (27) . 

The  other  RIN  program  examined  was  the  C-141  Atti- 
tude/Heading  Reference  System.  This  C-141  fleet  modifica- 
tion is  the  only  current  RIW  program  with  USA7  intermediate  i 

level  maintenance  and  contractor  depot  level  maintenance.  ! 

The  contract  provides  for  base  level  fault  isolation  and 
card  replacement.  If  the  equipment  cannot  be  repaired 
at  base  level , the  line  replaceable  unit  (LRU)  is  shipped  to 

i 

the  contractor's  plant  where  the  failure  fault  is  jointly 
determined  by  OCAS  and  contractor  inspectors  within  con- 
tractual guidelines  (24). 

Both  the  AHRS  and  OMEGA  programs  are  currently 
experiencing  fewer  flying  hours  than  were  projected  in  their 
contracts » and  upon  which  the  contractors  based  their  war- 
ranty cost  estimates.  Both  contracts  provide  for  a down- 
ward adjustment  in  warranty  cost  in  this  situation.  If 
flying  hours  are  higher  than  projected,  both  contracts  pro- 
vide for  warranty  costs  to  be  adjusted  upward. 

A unique  feature  about  both  the  (MEGA  and  AHRS  pro- 
grams is  that  very  few  Class  I ECPs  have  been  submitted 
since  equipment  deployment.  None  have  been  submitted  on 
the  AHRS  and  approximately  three  have  been  submitted  on 
the  (MECaA.  Apparently,  both  contractors  did  Intensive 
design  work  before  and  during  initial  production  to 
increase  reliability  so  that  no  ECP  costs  would  be  incurred 
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during  thm  warranty  phase.  Part  of  the  rationale  for  use 
of  a RIW  is  that  low  MTBP  equipment  can  be  "grown"  to  a high 
MTBP  during  the  RIW  phase  by  engineering  changes,  but  it 
appears  that  both  contractors  have  avowed  this  expense 
by  concentrating  their  design  efforts  early  in  the  programs. 
While  this  is  not  the  way  the  DSAP  originally  thought  the 
RIW  concept  would  work,  both  program  managers  believe  the 
OSAP  has  benefitted  in  the  long  run  by  procuring  more  reli- 
able equipment. 

Generally,  it  appears  that  the  RIW  approach  has 
advantages  under  some  circumstances.  If  equipment  is 
advanced  state-of-the-art  with  a high  potential  for  improve- 
ment, then  use  of  a RIW  should  be  thoroughly  evaluated. 

On  the  other  hand,  if  the  equipment  is  subject  to  frequent 
changes  as  in  ECM  systems  (39)  , or  if  the  equipment  is 
already  highly  developed  with  little  growth  potential,  then 
a RIW  is  probably  not  economical  (24) . 

LCC  Verification  Testing 
Laboratory  Versus  Field  Testing 

When  the  major  basis  for  production  contract  award 
is  the  LCC  proposed  by  the  bidders,  the  target  LCC  should 
be  included  in  the  contract  as  a firm  commitment.  When 
the  LCC  proposal  is  contractually  incorporated,  seme  pro- 
cedure must  be  provided  for  actual  measurement  of  the 
achieved  LCC.  This  measurmsent  can  be  accomplished  by 


•ithttr  • laboratory  taat  or  by  a fiald  test  under  actual 


operatla?  conditions. 

Choice  between  a laboratory  test  or  a field  test 
is  contingent  yapon  many  program  factors.  It  is  generally 
agreed  by  most  program  management  and  engineering  person- 
nel that  field  testing  is  more  realistic  and  prefereUale 
to  testing  accomplished  in  a laboratory.  The  major  reason 
is  that  it  is  difficult  and  expensive  to  duplicate  the 
variety  of  conditions  encountered  in  the  field  in  a labora- 
tory environment.  Also,  under  some  circxonstances , con- 
tractors are  able  to  "gold  plate"  or  "fine  tune"  laboratory 
test  articles  to  produce  unrealistically  favorable  results. 
This  problem  of  realistic  reliability  testing  in  a labora- 
tory environment  is  one  of  the  more  significant  problems 
facing  LCC  program  managers  in  current  programs  (7) . 

Program  managers  who  have  decided  to  use  laboratory 
testing  instead  of  field  verification  have  usually  cited 
the  following  reasons: 

1.  Field  testing  is  normally  very  time-consuming. 
Several  years  of  operations  are  usually  required  to  deter- 
mine actual  equipment  reliability  and  maintenance  problems 
with  any  degree  of  confidence  (10) . 

2.  Field  testing  is  expensive  to  administer, 
especially  in  manpower  terms  (13) . 
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3.  Failure  definltlon-’-detarmlnlng  what  consti- 
tutes a failure  and  who  caused  it— can  be  extronely  diffi- 
cult to  establish  (13) . 


4.  The  USAF  Maintenance  Data  Collection  System 
(MDCS)  is  generally  considereu  to  be  inadequate  for  test 
data  reporting  and  contractual  enf orescent  purposes.  There- 
fore, the  program  manager  must  structure  a separate  report- 
ing systsm  (25) . 

5.  Education,  and  re-education,  of  base  level 
maintenance  personnel  about  the  requironents  of  the  test 


program  can  become  a burden  (10) . 

6.  Monitoring  a test  program  and  verifying  failure 
data  can  be  a significant  difficulty  in  operational  environ- 


ments Involving  high  security  or  frequent  deployments  (7) . 

In  any  event,  the  program  manager  must  decide  if 
the  additional  effort  and  expense  involved  in  a field  test 
are  worth  the  increased  data  accuracy  and  higher  confidence 
which  is  obtained.  If  a laboratory  test  is  used,  care  must 
be  taXen  to  duplicate  as  closely  as  possible  the  conditions 
to  be  encountered  in  the  field.  Above  all  else  in  an  LCC 
procurasMnt,  the  contractor  must  be  motivated  to  achieve 
the  claims  made  in  his  proposal.  If  the  contractor  is  not 
motivated,  or  if  the  USAF  is  unable  to  verify  and  enforce 
contractor  compliance,  then  the  objective  of  LCC  procurement 


is  lost. 


6 
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Prooran  BxptIucs 

Actual  LCC  varlflcatlon  test  (LCCVT)  experience 
at  the  subsystem  level  Is  extrmnely  limited.  In  fact,  the 
All/ARC-164  radio  is  the  only  program  examined  which  has 
actually  conducted  an  extensive  base  level  test  of  the  con- 
tractor's reliability  and  maintainability  claims.  It  now 
appears  that  the  AM/ARC-164  LCCVT  has  been  generally  very 
successful/  and  is  now  providing  important  lessons  learned 
and  guidelines  for  other  current  and  future  programs.  Some 
of  the  AN/ARC-164  experience  is  discussed  below,  along  with 
pertinent  Information  frexa  other  programs. 


Structuring  the  LCCVT 

The  AN/ARC-164  program  attempted  to  approximate 
in  its  test  aircraft  and  locations  the  actual  mix  of  USAF 
aircraft  and  environments.  These  include: 


AIRCRAFT 
T-37,  T-38 
C-130 
P-100 


COMMAND  LOCATION 

Air  Training  Randolph  AFB,  TX 

Command  (ATC) 

Military  Airlift  Little  Rock  AFB,  AR 

Command  (MAC) 

Air  National  Barnes  Municipal  Airport,  MA 

Guard  (ANG) 


The  criteria  used  in  selecting  these  aircraft  and 
locations  were:  (a)  that  the  aircraft  have  relatively  lilgh 
operating  hours  per  month;  (b)  that  the  test  sites  be 
within  the  CONUS;  and  (c)  that  the  aircraft  be  representa- 
tive of  the  types  of  eurcraft  to  receive  the  radio.  The 
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test  sites  finally  selected  were  considered  representative 
of  the  varying  cliaatic  conditions  of  the  fleet  (1:12). 


Maintenance  Peyrsonnel 

The  AM /ARC-*  16 4 is  being  installed,  maintained, 
and  removed  by  aSAF  personnel.  The  original  cadre  was 
selected  by  the  USAF,  and  trained  and  certified  by  the 
contractor.  The  USAF  has  attempted  to  maintain  personnel 
stability  to  enhance  continxiity  of  effort,  although  this 
approach  has  been  criticized  as  not  being  representative 
of  real  world  USAF  maintenance. 

Each  test  base  has  a test  director  within  its  main- 
tenance organization  who  is  responsible  for  collecting 
all  data  and  reporting  to  the  program  test  director  at 
Wright-Patterson  AFB.  Problems  have  been  encountered 
because  of  frequent  test  director  changes  at  Little  Rock 
AFB  due  primarily  to  the  MAC  mission  and  the  use  of  active 
duty  personnel  in  this  job.  There  has  been  better  stability 
and  continuity  at  the  ATC  and  AM6  bases  because  of  their 
Increased  vise  of  civil  service  emd  National  Gvuurd  personnel 
in  maintenance  amd  test  director  duties  (10) . 

Maintenance  Data  Reporting 

Sa&e  authorities  believe  the  USAF  Maintenemce  Data 
Collection  System  is  usable  for  failure  reporting  in  support 
of  an  LCCVT  if  the  conditions  that  follow  are  met: 
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1.  Th«  failur*  dafinition  in  thm  contract  nuat 
ba  claar  and  undaratandabla. 

2.  Tha  Air  Forca  Tachnical  Ordar  Forma  349  and 
350  which  acccaq^y  failad  aquipnant  to  tha  dapot  muat 
ba  oorract. 

3.  Naintananca  paraonnal  at  baaa  laval  muat  ba 
wall  trainad  on  tha  iaportanca  of  tha  taat  program  and 
accuracy  of  documentation  (26). 

Bowavar,  tha  AN /ARC- 16 4 program  managamant  and 
taat  taam  did  not  faal  tha  MDCS  waa  adaquata  bacauaa  of 
tha  following  contractual  and  technical  conaidarationa t 

1.  Tha  atrong  poaaibility  of  a subatantial  price 
adjuatmant  raaulting  from  taat  unit  failuraa  required 
extremely  accurate  reporting  (It 24). 

2.  Under  tha  MDCSr  normal  maintenance  actiona 
can  ba  claaaad  aa  failuraa  and  tha  aama  fault  can  be 
reported  more  than  once  under  acme  circumatancaa  (10). 

3.  In  general,  maintenance  data  reporting  haa 
a high  error  rate  becauae  of  miarecording  of  itema  auch 
aa  dataa  and  codaa,  delation  of  Important  itama,  and 
incomplete  failure  daacriptiona  (26). 

4.  Baaa  maintenance  wor)c  unit  codaa  and  dapot 
maintenance  atocJc  nunbara  are  not  compatible.  Soma  aystem 
of  convaraion  and  accounting  between  tha  two  syatema  would 
have  had  to  have  bean  daviaad  (26) . 
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Th«  •xtrwMly  rsliabls  op«ratlon  of  tha  radio  haa  pravantad 
this  from  baconlng  a significant  pxbblan.  Tha  Tast  Diractor, 
howavar,  baliavaa  this  could  hava  bacoma  a major  araa  of 
disagraamant  if  tha  aquipmant  had  baan  lass  raliabla  and 
had  drlvan  Oas  costs  into  tha  contractual  panalty  araa 


(10) . 


Failura  dafinition  is  a key  alamant  to  a LCCVT. 


Failure  definitions  should  ba  carefully  developed  and 
thoroughly  reviewed  by  program  management,  engineering, 
procurement,  and  legal  personnel  prior  to  incorporation 
into  tha  contract.  Further,  exhaustive  discussions  should 
ba  conducted  with  contractors  before  contract  signature 
to  insure  the  definitions  and  procedures  are  completely 
and  clearly  vinderstood  (30:35). 


LCCVT  Effectiveness 

Tha  AM/ARC-164  Tast  Director  believes  the  verifica- 
tion test  and  special  reporting  system  have  been  generally 
effective,  providing  the  USAF  with  much  better  OaS  cost 
visibility  than  %rould  have  been  available  through  tho  MDCS 
or  froai  a laboratory  test.  Although  program  funds  were 
required  to  develop  the  original  computer  program  for 
updating  and  calculating  NTBF  experience,  that  program 
is  now  available  for  other  government  users.  .While  somer*' 
problems  have  been  encountered  at  base  level  dud  to  per- 
sonnel turnover,  tha  bases  hava  baan  extremely  helpful 
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and  cooparativa  to  all  program  managamant  and  tast  par- 
aonnal.  Finally » It  is  astimatad  that  tha  spaclal  moni- 
toring and  raporting  systm  raquiras  approximataly  .2  man 
yaars  at  A8D  and  .2  man  yaars  at  aach  of  tha  tast  basas. 
This  appaars  to  ba  a raasonable  invastmant  considaring 
tha  numbar  of  systams  and  contractual  dollars  involvad 
(10). 

Othar  Programs 

Nhila  tha  AM/ABC-164  is  tha  only  subsystm  laval 
program  axaminad  by  tha  rasaarchars  which  has  significant 
oparational  varification  tast  axparianca,  several  othar 
programs  deserve  brief  mention. 

Tha  AM/ARC-186  VHF  Radio  program,  which  has 
recently  completed  production  contract  award,  has  taken 
advantage  of  much  of  the  experience  gained  and  lessons 
learned  on  the  AM/ARC-164  program  and  has  attempted  to 
make  refinements  and  improvements  wherever  possible.  Tha 
general  program  and  verification  testing  structure  are 
similar  to  tha  AM/ARC-164.  It  is  too  early  to  examine 
this  program  in  depth,  but  it  offers  significant  promise 
for  future  research  (19). 

Tha  F-4  IMU  program,  discussed  previously,  employed 
an  unusually  rigorous  acceptance  tast  instead  of  a LCCVT, 
primarily  because  of  tha  expanse  and  time  Involvad  with 
field  varification.  This  approach  is  not  applicable  on 
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all  typaa  of  aqulpmant , but  could  of far  promlaa  In  soma . 
easas  (31) . 

Finally » tha  ACES  II  program,  mantionad  aarllar, 
is  using  a fiald  random  sampling  taqhniqua  to  varify 
raliability  Instaad  of  a Z«CCVT.  In  this  sampling  and  sur- 
vaillanca  program,  saats  ara  randomly  salactad  in  tha  field 
and  returned  to  tha  factory  where  they  ara  subjected  to 
inspection  and  explosive  verification  tasting.  This  test 
program  provides  tha  program  office  with  a good  picture 
of  equipment  raliability  and  LCC.  Again,  while  only  appli- 
cable to  certain  types  of  equipment,  this  technique  might 
prove  valuable  in  other  situations  (15). 


Proorm  Myacament  Responsibility 
Tra^fer  (PMW^ 

Normally  the  program  manager's  final  act  on  a pro- 
gram is  the  transfer  of  responsibility  from  AFSC  to  AFLC. 
In  most  cases  AFLC  will  not  accept  program  responsibility 
until  tha  production  contract  is  completed  and  closed  out. 
In  programs  with  lengthy  LCCVTs  and/or  RIWs,  AFLC  refusal 
to  accept  responsibility  can  require  the  ASD  program  mana- 
ger to  maintain  contractor  surveillance  and  administrative 
responsibility  for  much  longer  periods  than  are  considered 
desirable  (24).  While  this  is  a parochial  concern,  it 
presents  a real  problem  for  ASD  managers,  and  should  be 
ta)cen  into  consideration  when  structuring  test  programs 
and  RIWs. 
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CHAPTER  V 


LESSONS  LEARNED  AND  CONCLUSION 

Llfa  cycla  costing  has  baan  discussed  and  empha'- 
sisad  within  the  DOD  since  the  mid*  and  late*  1960s,  yet 
it  has  only  been  within  the  past  three  or  four  years  that 
LCC  has  been  seriously  applied  in  the  acquisition  of  sys* 
terns  and  subsystems.  One  of  the  major  reasons  for  the 
lengthy  delay  is  that  a great  deal  of  time  and  effort  is 
required  to  change  the  basic  orientation  emd  management 
philosophy  of  a leu:ge  orgemization. 

Since  the  beginning  of  defense  contracting,  empha* 
sis  has  been  on  procurement  of  equipment  at  the  lowest 
acquisition  cost.  LCC  procurement,  on  the  other  hand,  ceuti 
easily  require  that  more  funds  be  expended  in  the  acquisi* 
tion  of  equipment  in  order  to  save  money  in  future  operation 
and  support  of  the  system. 

Another  significant  factor  is  that  LCC  must  be  used 
as  a management  philosophy  throughout  the  entire  weapon  [j 

system  management  life  cycle  and  not  just  as  a technique  j 

that  is  applied  briefly  during  the  source  selection  phase 
of  a program  and  then  forgotten.  To  achieve  significant 
rediictlons  in  O&S  costs  of  systems  and  stxbsys terns  LCC  must 

j 

be  understood  and  emphasized  by  all  members  of  the  program 

i 
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managament  team,  not  only  by  the  program  manager.  The  pro-> 
gram  manager  cannot  accomplish  the  entire  spectrran  of  LCC- 
related  tasks  by  himself;  he  needs  the  assistance  and  sup- 
port of  procurement,  engineering,  cost  analysis,  logistics 
planning,  and  maintenance  personnel.  Bach  of  these  indi- 
viduals must  continually  emphasiza  LCC  in  all  of  their  deal' 
ings  with  contractors  and  they  must  use  LCC  as  a major 
criterion  in  all  program- related  decisions. 


All  of  the  programs  examined  in  this  study  were 
still  in  the  acquisition  phase;  some  were  in  FSD,  while 
others  were  in  source  selection  or  in  production  and  deploy- 
ment. While  final  lessons  learned  on  most  of  the  programs 
will  not  be  determined  for  at  least  another  several  years, 
the  researchers  believe  the  following  Itras  constitute  major 
lessons  learned  to  date  auid  significant  areas  of  concern 
for  futuire  ^program  managers. 


Maximua  LCC  effectiveness  is  obtained  when  LCC 


design  and  cost  tradeoffs  are  made  early  in  the  conceptual 
and  advanced  development  phases  of  a program.  LCC  can  and 
should  be  rigorously  applied  in  later  program  stages , but 
the  later  LCC  tradeoffs  are  made,  the  more  cost  reduction 


Contractor  Involve— nt 

use ‘ ( 

Jit  lout  until  LCC  tochniquu  oro  hotter  refined,  ^ 

oontrectora  should  be  notified  es  early  as  possible  of  the 
UShF's  intent  to  use  LCC  as  a basis  for  contract  award. 

Contractors  should  also  be  allowed  to  participate. as  much 
as  is  practicable  in  development,  modification  and  refine- 
ment of  LCC  models,  incentive  provisions,  and  failure 
definition  and  test  procedures. 

High  Cost  Drivers 

In  many  subsystems  and  items  of  eqixipment,  a small  | 

number  of  components  are  the  high  cost,  high  failure  rate, 
and  high  maintenance  elmaents.  Concentrating  program 
design  efforts  and  ruources  toward  Improvement  or  elimina- 
ting thue  few  items  can  significantly  improve  long-range 

0«s  cost  performance.  i 

i 

Cost  Estimating  Relationships  I 

CSSs  for  moat  subsystems,  especially  avionics  and 
electronic  warfare  equipment,  are  deficient.  A great  deal 
of  work  is  required  to  improve  cost  analysis  and  coat  esti- 
— ting  techniques  for  use  in  LCC  modeling  and  in  making 
progr—  cost  ud  design  tradeoff  decisions. 

LCC  Modeling 

Use  of  computer  models  in  source  selection  and  other 
program  phases  is  required  to  accurately  assess  contractor 
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ZiCC  claina.  LCC  nodttls  can  also  b«  axtramaly  valuable  in 
other  program  applications  such  as  determination  of  spares  | 

f 

requirasients^  budget  projections » and  as  continuing  program 
control  tools.  There  is  a need  for  simplified  models  which 
can  be  used  by  managers  of  small  programs  who  have  limited 
resources  and  staff  assistance. 

Incentives 

The  effectiveness  of  positive  incentives  in  LCC  i 

contracting  is  open  to  question.  Generally/  it  appears 
that  the  presence  of  a strong  negative  incentive  is  the 

best  motivator  for  good  contractor  LCC  design  and  manage-  I 

ment.  In  some  cases  where  thorough  LCC  design  work  has 
been  done  early  in  the  program/  and  where  there  is  competi- 
tion for  the  the  production  contract/  incentives  are  not 
required/  and/  in  fact/  probably  only  increase  administra- 
tive complexity  without  Improving  LCC  performance. 

Reliability  Improvement  Warranties 

RINs  can  significantly  lower  O&S  costs » but  the 
application  of  RIHs  seems  limited  to  a fairly  narrow  range 
of  prograais.  RIWs  are  not  appropriate  where  equipment  must 
be  modified  frequently  in  reaction  to  changing  threats  or 
where  MTBF  is  already  reasonably  high. 


I' 
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Pailur«  D»finition 


If  a varificatlon  test,  alther  fiald  or  laboratory, 
la  uaad  to  confirm  contractor  LCC  claima,  the  definition 
of  exactly  what  conatitutea  a failure  ia  a critical  elooent 
of  the  contract  and  the  teat  procedurea.  Alao,  the  pro- 
cednrea  for  determining  and  certifying  failurea,  and  for 
contractor  witneaaing/participation  in  maintenance  and 
fault  correction  are  critical.  Theae  itema  should  be 
thoroughly  coordinated  within  the  aSAF,  agreed  to  by  the 
contractor,  and  clearly  incorporated  into  the  contract. 

Verification  Testing 

If  a LCCVT  ia  to  be  conducted  in  an  operational 
environment  using  organic  maintenance,  there  are  significant 
advantages  to  the  use  of  ANG  emd  ATC  bases  because  of  their 
better  personnel  stability  and  reduced  turnover.  Mainte- 
nance quality  is  not  necessarily  better  at  AMG  and  ATC 
bases,  but  the  problem  of  frequent  test  program  personnel 
re-education  is  lessened. 

Recoamendatlons  for  Further  Research 

The  researchers  believe  the  following  LCC-related 
subjects  offer  significant ■ potential  for  future  research 
efforts: 

1.  Development  of  simplified  LCC  models  which  can 
be  used  by  program  managers  with  little  or  no  staff  support. 
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2.  Laprovamant  of  current  cost  estimating  tech- 
niques for  avionics  and  related  eqxiipment. 

3.  Examination  and  possible  standardization  of 
contract  provisions  for  LCC  contracts. 

Conclusion 

While  LCC  has  not  been  applied  in  the  management 
of  stdjsystem  level  acqriisition  programs  until  the  past 
several  years,  a great  deal  of  experience  is  now  being 
accumulated  on  current  efforts.  Analysis  of  this  experi- 
ence and  refinement  of  LCC  principles  and  procedures  should 
provide  program  managers  significantly  improved  techniques 
for  use  in  future  programs,  and  should  in  turn  result  in 
better  cost  visibility  and  an  overall  reduction  in  tJSAF 
system  ownership  costs. 
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S#ction  1 

1.  Did  your  program  hmvm  any  foaturM  or  chnractarlstica 

which  mado  it  particularly  aaay  or  difficult  to  apply 
LCC  charactaristica?  ..... 

2.  Nhat  wara  your  moat  difficult  LCC  problama  axid  how  did 
you  daal  idth  tham? 

3.  Nhat  do  you  faal  ara/wara  tha  moat  auccaaaful  LCC 
aapacta  of  your  program? 

4.  Do  you  faal  your  program  davalopad  any  aignificant 
and/or  uniqua  approachaa  to  tha  application  of  LCC 
principlaa? 

5.  Do  you  faal  thara  ara  affactiva  waya  to  apply  LCC 
principlaa  to  PSD  and  production  programar  or  la 
affactiva  application  limited  to  conceptual  and 
advanced  davalopmant  program  phaaaa? 

6.  At  what  point  should  production  contractors  be  con- 
sulted « or  allowed  to  participate  in,  tha  formulation 
of  an  LCC  plan? 

7.  Hava  you  received  any  meaningful  LCC  assistance  from 
AFSC  laboratories? 


Section  2 

8.  Nhat  types  of  LCC  models  have  you  used? 

9.  Nhat  wara  tha  strengths  and/or  weaknesses.  If  any,  of 
tha  sMdalCsl? 

10.  From  what  sources  did  you  obtain  cost/par foxmanca/ 
sdasion  inputs  for  tha  modal?  Do  you  faal  tha  data 
was  adequate? 

11.  At  what  point  in  your  program  was  tha  final  support 
concept  determined? 

Section  3 

12.  Nas  thara  any  attanpt  to  perform  a formal  risk  analysis 
from  tha  contractor's  viewpoint  prior  to  release  of 
tha  RFP  or  prior  to  contract  negotiation? 
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19.  What  do  you  fa«l  is  a raasonable  tine  period  to  hold 
contractors  responsible  for  the  OCS  costs  of  their 
equipment? 

20.  Does  the  current  naintenance  data  reporting  systan 
provide  adequate  feedback  to  demonstrate  contractor 
compliance  with  contract  LCC  provisions?  If  not, 
how  did  you  solve  this  problem? 

21.  Nhat  are  your  reconmendations  for  structuring  the 
following  aspects  of  LCC  field  verification: 

a.  Qualification  testing. 

b.  Verification  testing. 

c.  Maintenance  feedback. 

d.  Failure  definition. 
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